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Appendix A. The search, screening, and review process 
This appendix describes the literature search, screening, and review processes used in this report. 


Literature search methodology 

A comprehensive list of keywords was compiled from several sources including the National Early Literacy Panel 
and the What Works Clearinghouse (WWC) early childhood education topic area protocol (National Early Literacy 
Panel, 2008; What Works Clearinghouse, 2014). Four categories of search terms (target ages and settings, study 
design, interventions, and outcomes) were included and combined in each electronic database using the Boolean 
operators OR between search terms within each category and AND between sets of search terms comprising the 
four categories (boxes A1—A3) to identify peer-reviewed and grey literature. The interventions search term 
category contained three subcategories—general terms, curricula, and instructional practices—that each contain 
search terms linked by the Boolean operator OR within and across subcategories. The outcomes search term 
category contained six subcategories—language, phonological awareness, print knowledge, decoding, early 
writing, and general literacy—that each contained search terms linked by the Boolean operator OR within and 
across subcategories. 


These terms were used to search the following databases: Child Development and Adolescent Studies, EconLit, 
ERIC, ProQuest Dissertations, and PsycINFO. The study team also conducted a hand search for additional relevant 
articles from the 2016 and 2017 issues of several prominent research journals, including Child Development, 
Developmental Psychology, Early Childhood Research Quarterly, Early Education and Development, Journal of 
Educational Psychology, Journal of Learning Disabilities, Reading Research Quarterly, Scientific Studies of Reading, 
and Topics in Early Childhood Special Education. 


In addition, the reference lists from WWC intervention reports that used any of the WWC early childhood 
education review protocols (What Works Clearinghouse, 2005, 2009, 2010, 2014), research syntheses produced 
by the Institute of Education Sciences and other agencies, and meta-analyses were searched and cross-referenced 
with the results of the literature search to identify additional studies not captured in the initial search. 
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The references of 60 meta-analyses and literature reviews were examined and cross-referenced with the results 
of the literature search to identify additional studies that might not have been captured in the initial search. This 
process resulted in identifying some 150 additional studies. The meta-analyses and literature reviews were Al 
Otaiba and Fuchs, 2002; Al Otaiba et al., 2009; Allen, 2016; Anderson et al., 2003; Blok, 1999; Blok et al., 2005; 
Bowers et al., 2010; Breit-Smith et al., 2009; Burger, 2015; Burger and Winner, 2000; Burne et al., 2011; Bus and 
Van ljzendoorn, 1999; Camilli et al., 2010; Chambers et al., 2016; Chambers et al., 2010; Chambers et al., 2006; 
Christ and Wang, 2011; Connor et al., 2014; Darrow, 2009, 2010; Diamond et al., 2013; Ehri et al., 2001; Elleman 
et al., 2009; Filiatrault-Veilleux et al., 2015; Fukkink and Lont, 2007; Graham et al., 2018; Guo et al., 2016; Hosley, 
2000; Hsin et al., 2014; Jalongo and Sobolak, 2011; Kelchen et al., 2011; Kunkel, 2015; Lankshear and Knobel, 
2003; Lee et al., 2015; Lin, 2013; Ma et al., 2014; Magnuson et al., 2016; Markussen-Brown et al., 2017; Marulis 
and Neuman, 2010; McCoy et al., 2017; Mol et al., 2009; Moses, 2008; National Early Literacy Panel, 2008; Neale 
and Pino-Pasternak, 2017; Nelson et al., 2003; Odom and Strain, 2002; Petersen, 2011; Piasta and Wagner, 2010; 
Pidano and Allen, 2015; Reynolds et al., 2011; Schweinhart, 2001; Standley, 2008; Suggate, 2016; Swanson et al., 
2011; Takacs et al., 2014; Towson et al., 2017; Walker, 2011; Wasik et al., 2016; Zauche et al., 2016; and Zucker et 


al., 2009. 


Box A1. Keywords used for the target ages and settings and the study design search categories 


Target ages and settings 


3 year* old 
3-year-old* 

3 year 

4 year* old 
4-year-old* 

4 year 

5 year* old 
5-year-old* 

5 year 

Age*3 

Age*4 

Age*5 

Child care* 
Childcare 

Day care 
Daycare 
Day-care* 

Early childhood* 
Early experience 
Five-year-old* 
Four-year-old* 
Home school* 
Infant* 

Infantile 
Nurseries 
Nursery 

Prek* 

Pre-K 
Prekindergarten* 
Pre-kindergarten* 
Preschool* 
Pre-school* 


* indicates a wildcard character. 


Source: Authors’ compilation. 


Three-year-old* 
Toddler* 

Young child 
Young children 
Preschooler 
Preschoolers 


Study design 


ABAB design 

Alternating treatment 

Assignment 

Baseline 

Causal* 

Causality 

Changing criterion design 

Comparison group* 

Control group* 

Effect* 

Effective 

Effectiveness 

Efficacy 

Efficiency 

Evaluation 

Experiment 

Experimental 

Impact 

Intrasubject replication design 
match 

Literature review 

Matched group* 

Meta analysis 

Meta-analysis 

Multi element design 


Multi-element design 

Multiple baseline 

Multiple baseline design 

Multiple probe 

Multiple-probe 

Posttest 

Post-test 

Post test 

Predict* 

Prediction 

Predictive 

Pretest 

Pre-test 

QED 

Quasi experimental 

Quasi-experimental 

Random* 

Randomization 

Randomized Control* Trial 

Randomized controlled trial 

Randomly assign 

RCT 

RDD 

Regression discontinuity 

Reversal design 

Simultaneous treatment 

Single case design 

Single subject design 

Single subject experimental 
design* 

Systematic review 

Treatment 

Withdrawal design 
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Box A2. Keywords for the interventions search category, by subcategory 


General terms 


Approach* 

Basal reading 
Courseware 

Curricula* 

Curriculum 

Early childhood education 
Early intervention 
Educational method* 
Educational strategy 
Educational strategies* 
Educational therapy 
Emergent 

Initial teaching alphabet 
Instruct* 

Instruction 

Intervene* 
Intervention 

Language experience approach 
Learning* 

Literacy* 

Monitor* 

Practice* 

Program* 

Reading* 

Remedial* 
Remediation 

Strategy* 

Teacher* 

Teaching 

Technique* 
Therapeutics* 

Therapy training 
Train* 

Transfer 

Treat* 


Curricula? 


The Abecedarian Project 

A Beka 

Active Learning 

Bank Street Developmental 

Beyond Centers and Circle Time 

Breakthrough to Literacy 

Bright Beginnings 

Building Blocks for Literacy 

Building Early Literacy and 
Language Skills (BELLS) 

Building Language for Literacy (BLL 
Scholastic) 

Compass Learning Odyssey Pre-K/K 

Computer Assisted Instruction 

Core Knowledge Preschool 
Sequence 

Creative Curriculum 
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Curiosity Corner 

Daisy Quest 

DARE to be You 

Direct Instruction 

DLM Early Childhood Express 

Doors to Discovery 

Early Childhood Program 

Early Literacy and Learning Model 
(ELLM) 

Fast ForWord Preschool 

FunShine Express: Fireflies/Sprouts 

Funsteps, Inc. 

Growing Readers Early Literacy 
Curriculum (High/Scope) 

Headsprout Reading Basics 

High Reach 

High/Scope Curriculum 

Houghton Mifflin Prek 

Innovations Comprehensive 
Preschool Curriculum (Gryphon 
House Pub.) 

Interaction Approach 

Journeys into Early Literacy 

Kaplan Planning Guide to the 
Preschool Curriculum 

Ladders to Literacy: A Preschool 
Activity Book 

Language for Learning 

Language-Focused Curriculum 

Leap 

LeapDesk Workstation 

Learning Experiences: An 
Alternative Program for 
Preschoolers and Parents (LEAP) 

Learningames—Abecedarian 

Let’s Begin with the Letter People 

Lidcombe Program 

Lindamood Phoneme Sequencing 
Program (LIPS) 

Links to Literacy Curriculum Kit 

Literacy Express 

Marazon system 

Montessori Method 

My Magic Story Car 

Open Court Reading (OCR) Pre-K 

Open Court Reading Program 

Opening the World of Learning 

Pebble Soup 

Phonemic Awareness in Young 
Children: A Classroom Curriculum 

Phono-Graphix 

Primrose Schools 

Project Approach 

Project Construct 

Read, Play, and Learn! 

ReadingLine Kits 


Ready, Set, Leap! 
Reggio Emilia 
Rigby’s Activate Early Learning 
Saxon Early Learning 
Scholastic Early Childhood Program 
School Readiness Express 
Sing, Spell, Read, & Write Sound 
Foundations 
Smart Start 
Sound Foundations 
Sounds Abound 
Spell, Read, PAT 
S.P.A.R.K. 
Stepping Stones to Literacy 
Storytown 
Tools of the Mind 
We Can! Curriculum 
Waterford Early Reading Program 
Pre-K 
Wee Learn 
Words and Concepts 


Instructional practices 


Book reading 

Classwide peer tutoring 

Conversational-recasting 

Conversation-based language 
intervention 

Dialogic reading 

Direct instruction 

Explicit attention to articulation 

Family literacy 

Functional communication training 

Graphics-based software tools 

Home literacy 

Imitation-based language 
intervention 

Individualized reading 

Interactive shared Book Reading 

Interactive shared picture book 
reading 

Letter knowledge training 

Peer training 

Peer-mediated intervention 

Phonological awareness training 

Phonological awareness training 
plus letter knowledge training 

Picture book reading 

Pragmatic teaching 

Reciprocal teaching 

Redirect 

Repeated reading 

Self-initiated augmentative 
communication treatment 

Shared book reading 

Stimulus control procedure 
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Storybook reading 

Sustained silent reading 

Syntax program 

Teaching phonological awareness 
Teaching rhyming 


Teaching story grammar 

knowledge 
Teaching-script 
Text-based software tools 
Time delay 


Verbal labeling responses 
Video discourse intervention 
Written text cueing 


1. These curricula represent commercial products that have been identified by the What Works Clearinghouse (WWC). The WWC website includes 
intervention reports for some of these curricula, but approximately 71 percent have not been updated in the past 10 years, as of June 28, 2017. 


* indicates a wildcard character. 


Source: Authors’ compilation. 


Box A3. Keywords for the outcomes search category, by subcategory 


Language 


Cohesive adequacy 
Communicate 
Communication 
Comprehend 
Comprehender 
Comprehension 
Comprehension monitoring 
Context clue 
Discourse skills 
Expressive 
Following direction 
Grammar 
Grammatical 
Language 
Language sample analysis 
Lexical 

Lexical diversity 
Listen 

Listening 

Mean length of utterance 
Metalinguistics 
MLCU 

MLU 

Morpheme 
Morphological 
Morphology 
Naming 

Narrative 

Oral language 
Picture vocabulary 
Pragmatics 
Productivity 
Prosody 
Psycholinguistics 
Recall 

Receptive 

Retell 

Schema theory 
Semantics 
Sentence completion 
Sentence recalling 
Sentence structure 
Sociolinguistics 
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Speech 

Spoken language 
Story 

Story grammar 
Subvocal 
Syntactic 

Syntax 

Text structure 
Vocabulary 


Phonological awareness 


Alliterate 

Alliteration 

Alliteration matching 
Alliteration oddity 
Blend* 

Blending 

Compound 

Consonant 

Delete* 

Deletion 

Elision 

Final phoneme elision 
Final sound 

Initial sound 

Medial sound 

Onset 

Onset rime blending 
Onset rime 

PA 

Phoneme 

Phoneme blending 
Phoneme blending into nonwords 
Phoneme blending into words 
Phoneme elision 
Phoneme isolation 
Phoneme manipulation 
Phoneme segmentation 
Phoneme substitution 
Phonemic 

Phonetic 

Phonological 

Rhyme* 

Rhyme matching 


Rhyme oddity 
Rhyme production 
Rhyming 

Rime 

Segment* 
Segmentation 
Sound* 

Syllable* 

Syllable blending 
Syllable elision 
Vowel* 

Word blending 
Word completion 
Word elision 


Print knowledge 


AK 

Alphabet* 
Alphabetical 

Book concepts 
Concept of word 
Concepts of word 
Concept* 

Concept about print 
Concepts about print 
Concept of print 
Concepts of print 
Convention of print 
Conventions of print 
Directionality 
Environmental text 
Environmental* 
Left-to-right orientation 
Letter case 

Letter identification 
Letter knowledge 
Letter name 

Letter names 

Letter naming 

Letter recognition 
Letter retrieval 
Letter sound 

Letter sound correspondence 
Letter sounds 


A-4 


Letter-sound 
Letter-sound correspondence 
Lowercase letter 
Phoneme grapheme 
correspondence 
Phoneme-grapheme 
correspondence 
Print awareness 
Print* 
Punctuation 
Sight* 
Sound letter 
Sound* 
Sound-letter 
Uppercase letter 
Word 


Decoding 


Consonant* 

Decode* 

Decoding 

Grapheme* 

Letter sound correspondence 

Letter-sound correspondence 

Morpheme* 

Morphological 

Morphophonemic 

Orthograph* 

Orthographic 

Orthography 

Pattern recognition 

Phoneme* 

Phoneme grapheme 
correspondence 


* indicates a wildcard character. 


Source: Authors’ compilation. 


Phoneme-grapheme 
correspondence 

Phonetic 

Phonic 

Phonics 

Phonology 

Structural analysis 

Syllable* 

Vowels 

Word list 

Word lists 

Word reading 

Word recognition 

Word* 


Early writing 


Composition 
Dictation 
Direction 

Dot 

Emergent writing 
Encode 

Encoding 
Invented spelling 
Letter writing 
Line 

Linearity 

Mark 

Message 
Morphophonemic 
Name writing 
Orthographic* 
Scribble 
Scribbling 


Screening process and study eligibility criteria 


Signature 

Spell* 

Spelling 

Symbol 

Write 

Writing 

Writing ability 
Writing achievement 
Writing development 
Writing expression 
Writing fluency 
Writing name 
Writing readiness 
Written composition 
Written expression 
Written production 


General literacy 


Academic 
Achievement 
Combined score 
Composite score 
Early childhood 
Early* 

Language arts 
Lexical* 
Lexicology 
Literacy 
Literacy* 
Readiness 
Reading* 

Total score 


The study abstracts and full reports of the 74,001 unique studies identified through the literature search were 
screened for eligibility. Studies that were eligible for review met the following relevancy criteria: 


e Study design. Studies must have used a randomized controlled design, quasi-experimental design, or a single- 
case design. 


e Publication date. Studies must have been published between January 1, 1997, and December 31, 2017. 
e Sample. Studies must have included a student sample that met the following criteria: 


o Preschoolers. Children ages 36—71 months (that is, at least 3 years, O months old and not yet 6 years, 0 
months old) who had not yet entered kindergarten and who were receiving school-, center-, or home- 
based instruction delivered by a practitioner (for example, school- or center-based personnel, a speech- 
language pathologist, or a paraprofessional). The review did not include studies that contained children 
in kindergarten unless the study findings disaggregated the results for preschool children or preschool 
children represented at least 60 percent of the children in the sample. Studies that provided children’s 
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ages but not grade levels were reviewed when the mean age of the children in the sample was greater 
than 36 months and less than or equal to 60 months. 


o General education students. At least 50 percent of the children in each study were general education 
students and were not classified as an English learner student or a student with disabilities (children with 
a speech or language impairment were eligible for inclusion). 


o Location of the intervention. The children must have attended a program in a country that is similar 
enough to the United States that the study could be replicated in the United States (for example, in which 
English is the predominant language). 


Intervention types 


The interventions considered for inclusion must have had a goal or goals of enhancing language, phonological 
awareness, print knowledge, decoding, early writing, or general literacy performance (see definitions below); the 
interventions could have had goals outside these domains as well. For example, a program that teaches language 
and math was eligible for inclusion because one of its goals is language. Interventions must have been 
implemented in a school- or center-based setting (for example, a child care center, school- or community-based 
preschool, or other center-based early childhood setting) and delivered by a researcher or practitioner (for 
example, school- or center-based personnel, a speech-language pathologist, or a paraprofessional). Interventions 
implemented in a home-based setting or a clinic (for example, a speech-language pathology clinic) were excluded. 
At least 75 percent of the language used during instruction must have been in English to be included. The program 
might have included other components (for example, parent training, education), but only curricula and 
instructional practices that fit the criteria above were included. Figure Al demonstrates the decision tree for 
categorizing intervention type. 


Definitions and inclusion criteria for each intervention type are as follows: 


e Curriculum. A set of activities, materials, or guidance for working with children that serves as the primary 
instructional tool designed to meet children’s learning needs in multiple areas (for example, Creative 
Curriculum) or that is designed as a supplement to the primary instructional tool (for example, At risk Tier 2: 
Developing Talkers). A curriculum could—but did not have to—have a clearly identified name and included 
home-based programs delivered by a practitioner (for example, school- or center-based personnel, a speech- 
language pathologist or a paraprofessional). State and federally funded sources (for example, a state funded 
prekindergarten program or Head Start) were excluded because different curricula and instructional practices 
are used across sites receiving funding from the same source. 


e Instructional practice. A specific teaching method that guides the instructional interaction with children. 
Examples include dialogic reading and phonological awareness training. 


e Lesson package. A set of lesson plans with a clearly identified name. An intervention that combined two or 
more named interventions (for example, an intervention that combined Kindergarten Peer Assisted Literacy 
Strategies and Developing Talkers) was also considered a lesson package. 


e Technology program. A program that uses a form of technology (such as a computer or audio player) to deliver 
instruction to students. An intervention was coded as a technology program when the intervention comprised 
exclusively a single or multiple technology programs. 


In the overall rating of effectiveness, the study team included any comparison that permitted the effects of the 
intervention to be estimated. In some cases this meant that an entire curriculum, lesson package, instructional 
practice, or technology program was compared with a business-as-usual comparison group (for example, a typical 
preschool curriculum). In other cases this meant that the additive effects of a particular component of a practice 
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(for example, adult interaction during shared book reading) was examined in relation to the practice in absence 
of that additive component (for example, shared book reading). It can also mean that one intervention was 
compared with another. 


Figure A1. Decision tree for categorizing intervention type 


Does the entire intervention use 
one or more technology programs 


= only? 
| 
| | 
If yes, If no, does it serve as the primary instructional 
technology tool or a supplement to the primary instructional 
Naa program = tool? 
If yes, If no, does it include lesson 
curriculum an plans? 
If yes, is ita named If no, instructional 
es intervention? a practice 
If yes, If no, is it composed of two or more 
— lesson package si named programs? 
If yes, If no, 
lesson package __ Instructional practice 


Source: Authors’ compilation. 


Outcome domains 


The primary outcome domains for this review are language, phonological awareness, print knowledge, decoding, 
early writing, and general literacy. The structure of the outcome domains in this review are supported by research 
evaluating the dimensionality of language and literacy constructs with prekindergarten children (Anthony & 
Lonigan, 2004; Catts et al., 2015; Language and Reading Research Consortium, 2015; Puranik et al., 2011) and are 
generally consistent with the predictive validity findings in National Early Literacy Panel (2008). Only direct 
assessments and observations (for example, standardized and researcher-developed assessments) and teacher 
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ratings of child outcomes were eligible for review under this protocol. Outcomes must also be in English to be 


eligible for review. Additional information about each domain is described below: 


Language. Includes outcomes in the areas described below:? 


o Vocabulary. The development of knowledge about the meanings, uses, and pronunciation of words. 
Vocabulary tasks include receptive vocabulary (words understood) and expressive vocabulary (words 
used). 


o Listening comprehension. The ability to understand spoken language or text read aloud. 


o Syntax. The ability to display developmentally appropriate knowledge of the rules for combining words 
into phrases and sentences. Measures of syntactic skill include both receptive tasks (selecting correct 
responses) and expressive tasks (producing correct responses). 


© Narrative understanding and production. The ability to comprehend the basic structure and elements of 
stories, including the concepts of characters, settings, events, sequences, problems, and outcomes. It also 
refers to children’s inclusion of these elements in their own oral narratives. Narrative understanding can 
be demonstrated in a variety of tasks, including narrative production, retell, acting out of stories, and 
specific responses to queries. 


o Composite language. An outcome that encompasses more than one of the other language constructs. 


o Not otherwise specified. An outcome that assesses a student’s ability to comprehend or use spoken 
language but cannot be classified as any of the above constructs. 


Phonological awareness. Encompasses phonological and phonemic awareness. Phonological awareness refers 
to awareness of larger spoken units such as syllables and rhyming words. Tasks of phonological awareness 
might require students to generate words that rhyme, to segment sentences into words, to segment 
polysyllabic words into syllables, or to delete syllables from words (for example, what is “candy” without 
“dy”’?). Phonemic awareness refers to the understanding that the sounds of spoken language—phonemes— 
work together to make words and that phonemes can be substituted and rearranged to create different 
words. Tasks of phonemic awareness include the ability to identify, think about, and blend the separate 
sounds of a word (for example, “/c/ /a/ /t/ — cat”). 


Print knowledge. \Includes outcomes in the areas described below: 
o Letter knowledge. Knowledge of the names and sounds of the letters of the alphabet. 


o Concepts about print. Knowledge of print, such as print carries a message; print has conventions, such as 
directionality (left to right, top to bottom), differences between letters and words, distinctions between 
uppercase and lowercase, and punctuation; and books have some common characteristics (for example, 
author, title, front and back). 


Decoding. Knowledge that there is a predictable relationship between phonemes (the sounds in spoken 
language) and graphemes (the letters used to represent the sounds in written language) and that such 
relations can be used to decode or read words. 


1 Measures from language sample analyses were included and categorized under the most appropriate language construct. 
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e Early writing. Includes outcomes in the areas described below: 
o Letter writing. The ability to write letters. 
o Name writing. The ability to write one’s own name. 
o Spelling. The ability to use phoneme-grapheme relations or orthographic rules to write words. 


o Written expression. The understanding that writing conveys meaning. These tasks could include attempts 
to communicate information through scribbles, symbols, marks, letters, words, or sentences or 
demonstration of the understanding that writing conveys meaning. 


e General literacy domain. Includes outcomes that combine measures in two or more of the previous domains 
(language, phonological awareness, print knowledge, decoding, and early writing) or two or more constructs 
across domains or that provide some other type of summary score across domains or constructs, such as a 
“total reading score” on a standardized reading test or a kindergarten readiness score. 


Reviewing studies using What Works Clearinghouse evidence standards 


Of the 74,001 unique studies identified by the search procedures, 357 met the eligibility criteria and were 
reviewed using the WWC Procedures and Standards Handbook (version 4.0) for group design and single-case 
design studies (What Works Clearinghouse, 2017a, 2017b). All reviewers were certified in the WWC standards, 
version 4.0. Because the online study review guide for entering version 4.0 reviews into the WWC database as 
required by the Institute of Education Sciences (IES) for its contractors starting in late 2017 was not ready at the 
time of these reviews, the study team could not use an official WWC protocol for the reviews. Consequently, the 
reviews, while conducted using the latest WWC standards available at the time, were not entered into the 
database of official WWC reviews maintained by IES. Therefore, the studies discussed in this report cannot be 
described as meeting WWC evidence standards with or without reservations or as not meeting WWC evidence 
standards. After the first reviewer determined the rating of a study, the study was independently reviewed and 
rated by a second reviewer. A senior reviewer then double-checked the first and second reviews to ensure 
accuracy and reconcile any differences between the two. Of the 357 studies that were reviewed, 109 were rated 
as high-quality impact studies (figure A2). The summary of interventions described in this report includes only 
interventions that two reviewers determined met evidence standards for high-quality impact studies. 
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Figure A2. The study team identified 109 studies, representing 132 interventions, that were rated as high- 
quality impact studies; 37 of those studies, representing 38 interventions, demonstrated effectiveness on at 
least one language or literacy outcome domain 


74,001 Met evidence standards, as determined by the 
studies found in review team (95 group design studies and 14 
literature search single-case design studies). 


A total of 132 interventions are represented (118 
used a group design and 14 used a single-case 


357 design). 


met eligibility 
screening 
Included at least one intervention demonstrating 
effectiveness on a language, phonological 
awareness, print knowledge, decoding, early 
writing, or general literacy outcome (33 group 
design studies and 4 single-case design studies). 


A total of 38 interventions are represented by 
these studies (34 used a group design and 4 used 
a single-case design). 


Source: Authors’ compilation. 


Of the 357 studies reviewed, 248 were rated by the study team as not meeting the evidence standards. Of those 
248, 44 percent were unable to establish baseline equivalence for the analytic sample between the intervention 
and comparison groups (table A1). Baseline equivalence must be demonstrated for randomized controlled design 
studies with high attrition and for quasi-experimental design studies. Within each outcome domain, if any baseline 
measure is considered nonequivalent, the entire domain is rated as lacking baseline equivalence. Studies with 
multiple outcome domains receive a rating for each domain based on the establishment of baseline equivalence. 
If a study does not demonstrate baseline equivalence across all domains, the study is rated as not meeting the 
standards. About 38 percent of the studies rated as not meeting the evidence standards included a confound, 
which means that the study findings cannot be attributed solely to the intervention. A confound can occur when 
only one unit is assigned to one or all conditions or when the intervention was always used in combination with 
another intervention. About 5 percent of the studies rated as not meeting the evidence standards did not meet 
validity and reliability requirements, included outcome measures that were not collected in the same manner for 
all participating children, or included outcome measures that were considered overaligned. 
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Table A1. Reasons studies were rated as not meeting the evidence standards, as determined by the study 
team 


Number of Share of total 
Reason studies (percent) 
Baseline equivalence of the intervention and comparison groups used for the analysis was 108 44 
not demonstrated.° 
The measure of effectiveness could not be attributed solely to the intervention. There was 94 38 
only one unit assigned to one or both conditions (confound). 
The eligible outcomes did not meet requirements for validity and reliability.” 5 2 
The outcomes were not collected in the same way for all participating children. 4 2 
Overaligned outcome. 2 1 
Did not use acceptable approach to address all missing data in the analytic sample. 4 2 
No credible analysis of effect was included. 2 1 
Single-case design study with insufficient data points. 22 9 
Single-case design study with conditions for manipulation of the independent variable that 5 2 
were not determined by the researcher. 
Single-case design study with outcome that did not meet requirements. 2 1 
Total 248 100 


Note: Percentages do not sum to 100 because of rounding. 

a. According to What Works Clearinghouse (WWC) standards for group design, baseline equivalence should be demonstrated for quasi-experimental design 
studies or high-attrition randomized controlled trials with some missing or imputed baseline data in the analytic sample. A study is rated as not meeting 
WWC group design standards if baseline equivalence was not demonstrated in an outcome domain or if the analysis did not include an acceptable statistical 
adjustment to meet the requirement. 

b. According to WWC standards for group design, outcome measures must demonstrate sufficient face validity and reliability. To demonstrate face validity, 
a measure had to be defined and had to assess what it was described as assessing. Reliability for group-design studies was assessed using the following 
standards determined by the WWC: internal consistency (at least of .50), temporal stability or test-retest reliability (at least of .40), or interrater reliability 
(at least of .50). 

Source: Authors’ compilation. 


Coding the description of the intervention in the 109 studies that met the evidence standards 


The 109 studies that the study team determined met the evidence standards and their 132 included interventions 
were coded by the study team according to a common set of codes. A code book was created to capture the 
implementation characteristics and instructional features specific to each instructional domain. Study team 
members were trained to reliably use the codebook. 


Implementation characteristics 


e What is the type of intervention? See the “Intervention types” section for the definition of each intervention 
type (curriculum, lesson package, instructional practice, and technology program). 


What is the grouping/group size in which students experience instruction? One or more of the following were 
selected: whole class (6 or more students and 80 percent or more of the class), large group (6 or more students 
and less than 80 percent of the class), small group (2—6 students), or one on one. 


What is the total duration of the intervention? Coders noted the number of minutes each session lasted, the 
number of sessions that occurred each week, and the number of weeks the intervention lasted. This 
information was used to categorize the intervention into one of four categories: less than 2 hours, 2—25 hours, 
26-50 hours, or more than 60 hours. 


Who implemented the instruction with children? One or more of the following options were selected: 
researcher (including researcher assistant or hired staff), teacher (including classroom teacher, special 
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education teacher, or teacher assistant), technology (with or without adult supervision), or other (including 
speech-language pathologists, paraprofessionals, volunteers, or parents). 


e Are written lesson plans provided for interventionists? 


e Is professional development provided for interventionists prior to implementing the intervention? If yes, what 
is the duration? 


e Is ongoing support provided for interventionists during implementation of the intervention? 


Instructional features 


e Language 


o Is connected text (for example, a book) present? Connected text refers to multiple sentences that are 
related to each other. What type of book was used (ABC or narrative)? 


o Does the intervention include children listening to read aloud text? Does the implementer ask students 
questions pertaining to the connected text before, during, or after shared book reading? 


o Which instructional components and techniques are included? 


Narrative text structure. Intervention focuses on story grammar or narrative text structures such as 
character, setting, problem, resolution, or sequence of events. 


Expository text structure. Intervention focuses on expository text structures such as cause and effect, 
information in sequence, or ordinal keywords. 


Comprehension, inference, and elaboration. Text is not required for comprehension interventions. 
Interventions focusing on comprehension might include such instructional components as identifying 
the main idea, connecting story to life, drawing inference from literal or nonliteral questions, or 
passive listening. Instructional techniques might include modeling, asking questions by adults or 
children, making a prediction, recalling or retelling a story, acting-out a story, making an oral or 
written extension, or reading text to children. 


Vocabulary. Intervention focuses on promoting vocabulary by labeling, identifying, or pronouncing 
vocabulary by adults or children. Other instructional activities might include providing a definition, 
written exposure, systematic repeated exposure, oral text reading, or elaboration (for example, 
synonym/antonym generation, category sorting, connecting to life, describing attributes, verb 
demonstration, or providing example/nonexample). 


Morphology/morphosyntax. Intervention focuses on word parts and their roles and functions (for 
example, “un” at the beginning of a word usually means “not”; adding “s” at the end of a word 
typically means plural). Instructional technique might include modeling, asking question by adults or 
children, making an extension, recasting, using gestures, retelling a story, or playing interactive games. 


Phrasal/sentence syntax. Intervention focuses on the formation of sentences and the associated 
grammatical rules. Instructional technique might include modeling, asking question by adults or 
children, making an extension, recasting, using gestures, retelling a story, or playing interactive games. 


WH- questions. Intervention involves responding and generating WH- questions (for example, who, 
what, where, and when). Instructional technique might include modeling, question generation by 
adults or children, using gestures, retelling a story, or playing interactive games. 
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= £Extending/elaborating expressive language. |Intervention focuses on supporting children’s expressive 
language complexity. Instructional technique might include modeling, making an extension, recasting, 
cloze elicitation, asking open-ended questions, or playing interactive games. 


=  Speech-production (phonology-related). Intervention focuses on eliciting speech-production to fulfill 
a phonology-related instructional goal. 


= Pragmatics. Intervention focuses on communicative rules such as turn taking. 


Phonological awareness 


Is connected text (for example, a book) present? What type of book was used? (ABC or narrative) 


What instructional tasks and sound units are taught? The instructional tasks might include blending, 
deleting, substituting, identifying, matching or sorting, segmenting, or counting sound units. Other 
instructional tasks include producing or reciting words that share the same sound unit. Sound units might 
include first phoneme or onset, final consonant, vowel, body-coda, rime unit, syllable, or word. 


What is the sequence of intervention? The sequence could be specified by task or unit. 


Print knowledge 


© Is connected text (for example, a book) present? What type of book was used (ABC or narrative)? 

o What letter knowledge skills are taught? The intervention might focus on letter sounds, letter names, or 
orthographic shape. 

o Whatis the quantity of letter sounds or letter names taught? The quantity of letter sounds or names could 
be either the whole alphabet or a subset of the alphabet. 

o What is the sequence of letter names and sounds in the intervention if both are taught? The sequence of 
skills could be letter name first, letter sound first, or simultaneous. 

o What concepts about print are taught? The instructional activities might focus on the definition of author 
or illustrator, book conventions (for example, front cover, text, or illustration), the directionality of print, 
the use of punctuation, the one-to-one word-to-speech correspondence, and that print is what is read 
and conveys meaning. 

Decoding 

o Is connected text (for example, a book) present? What type of book was used? (ABC or narrative) 

o What instructional tasks and unit are taught? The instructional task might include blending into words, 
segmenting from words, or reading words. The units being manipulated might include single syllable or 
multisyllable words (or nonwords). 

Early writing 

o Is connected text (for example, a book) present? What type of book was used (ABC or narrative)? 

o What instructional tasks and units are taught? 


= Individual letter formation. Intervention focuses on individual letter formation by adults or children. 
Instructional activities might combine adult- or child-generated and adult- or child-encoded letters. 
Techniques used during the instruction might include copying or tracing. 


=" Whole word encoding. Intervention focuses on whole word writing in isolation by adults or children. 
Instructional activities might combine adult- or child-generated and adult- or child-encoded words. 
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Techniques used during the instruction might include copying, tracing, spelling, or letter by letter 
dictation by adults. 


=" Connected text. Intervention focuses on sentence, phrase, or paragraph writing by adults or children. 
Instruction tasks might combine adult- or child-generated and adult- or child-encoded text. 
Techniques used during the instruction might include copying, tracing, spelling, or word by word 
dictation by adults. 


Calcluations of weighted effect sizes and confidence intervals 


This section provides detailed information on how weights were applied to effect sizes based on sample sizes and 
on the adjustments made to fixed-effects models to create random-effects models. 


Weighting effect sizes. Prior to combining effect sizes across multiple samples, a weight was calculated for each 
effect size (equation A1). The assumption is that effect sizes based on larger sample sizes will produce effect sizes 
more similar to the “true” effect in the population than smaller sample sizes will. Therefore, effect sizes based on 
larger sample sizes are given more weight when calculating the average effect size than effect sizes based on 
smaller sample sizes (Cooper et al., 2009). 


_  2nirtnic)nirnic 
2(nipt+nic)* + NirNicgi? 


i (A1) 

where w;, is the weight for each effect size, n;7 is the sample size for the treatment (or intervention) condition, 
Nic is the sample size for the comparison condition, and g; is the effect size estimate. The weight represents the 
inverse of the standard error of the estimate. 


The weighted effect size is then calculated as the sum of the products of the effect sizes and their weights, divided 
by the sum of the weights (equation A2). 


kK osw; 
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where g_ is the weighted effect size, g; is the effect size for the ith comparison, w; is the corresponding weight 
(equation A1), and k is the total number of effect sizes being combined. 


The 95 percent confidence interval represents the range of effect size values within which the “true” effect is likely 
to exist with 95 percent certainty (equation A3). If the calculated range of effect size values includes O, the average 
weighted effect size is indistinguishable from 0. 


1 
Clg.95% = J. + 1.96 y: ; (A3) 
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where Clg.95% is the 95 percent confidence interval, g is the weighted effect size, and a w;, is the sum of the 
weights for the effect sizes being combined. 


The confidence intervals in a random-effects model are calculated differently to account for additional possible 
sources of error. In a random-effects model an alternative calculation is used to estimate effect size weights 
(equation A4). All confidence intervals reported are based on random-effects models. 


Wi =a (a4) 
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where w; is the random-effects weight for each effect size, se; is the standard error of the estimate, and H% is the 
additional error component (see equation AS). 


Adjustments for random effects. In this review, results are reported for the random-effects model. This analytical 
model assumes that the “true” effect might vary from study to study. For example, the effect size might be a little 
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larger if the students are younger, if the students are at greater risk for reading difficulties, or if the study used a 
more intensive or comprehensive intervention. The curricula, lesson plans, and instructional practices included in 
this report represent a wide range of early literacy interventions. Although this review examined one 
implementation characteristic or instructional feature at a time in its estimation of effects, there might still be 
variability in interventions that share the same characteristics or features. Given the wide range of interventions 
and implementation characteristics, the study team adopted the random-effects model for the analyses (Cooper 
et al., 2009). 


To account for random effects, an extra component, fg, is added to the standard error associated with an effect 
size estimate. The inverse of the standard error estimate becomes the new weight for the effect. The formula for 
Bg as reported in Lipsey and Wilson (2001) is: 


where Q is the Hedges’ Q statistic, k is the number of effects, and w is the weights. 


The Hedges’ Q statistic tests for homogeneity of effects and represents a test of the assumption that all effect 
sizes are estimating the same population value. The Hedges’ Q statistic follows a y7 distribution with k — 1 degrees 
of freedom when effect sizes are estimating the same population value. A statistically significant Q statistic (that 
is, one that exceeds the critical value for v2 with the appropriate degrees of freedom) suggests that factors 
associated with the particular samples might be affecting the effect sizes. Therefore, a significant Q statistic 
provides justification to explore whether particular features of samples or research conditions might be related 
to magnitudes of effect sizes (Cooper et al., 2009). 


The method used to calculate Hedges’ Q statistic for this report is: 
Q= Zwi(g- gw)’ (AB) 
where w; is the fixed-effect weight associated with the ith effect size, g is the corresponding effect size, and gy, 


is the fixed-effect weighted effect size estimate. 


In practice, adding the additional error to the standard error has two effects. First, it reduces the impact of the 
sample size weights on the weighted effect size. Second, it increases the confidence interval around the weighted 
effect size, thereby making it less likely to find a significant effect. 
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Appendix B. Technical results 


This appendix provides technical results pertaining to the primary research question and the additional 
subquestions addressed in the body of the report. Specifically, this appendix includes tables that report findings 
by study design (that is, group design and single-case design), details pertaining to the reported weighted effect 
size estimates, and figures that depict the distribution of implementation characteristics and instructional features 
among the 132 interventions that were evaluated by the 109 studies that the study team determined met the 
evidence standards. Box B1 defines key terms used in this appendix. 


Box B1. Key terms 


Benjamini-Hochberg correction. A correction used to reduce the possibility of mistakenly concluding that the effects are 
significantly different from zero (called Type | error in hypothesis testing) because repeated tests of highly correlated 
measures in the same outcome domain can lead to inflated estimates of the effects. 


Effective outcome. An outcome domain in a studied intervention that used a group design and demonstrated a statistically 
significant positive effect after multiple comparisons were adjusted for using the Benjamini-Hochberg correction. This term 
also refers to an outcome domain in a studied intervention that used a single-case design and demonstrated strong or 
moderate evidence of a positive effect based on the criteria described in version 4.0 of the What Works Clearinghouse (WWC) 
standards for single-case designs (What Works Clearinghouse, 2017). 


Group design. A study design in which outcomes for a group receiving an intervention are compared with outcomes for a 
comparison group. Examples of group designs include randomized controlled trials and quasi-experimental designs. 


Inconclusive outcome. An outcome domain in a studied intervention that used a group design and did not demonstrate a 
statistically significant effect after multiple comparisons were adjusted for using the Benjamini-Hochberg correction. This 
term also refers to an outcome domain in a studied intervention that used a single-case design and demonstrated no evidence 
of an effect based on the criteria described in version 4.0 of the WWC standards for single-case designs (What Works 
Clearinghouse, 2017). 


Not effective outcome domain. An outcome domain in a studied intervention that used a group design and demonstrated a 
statistically significant negative effect after multiple comparisons were adjusted for using the Benjamini-Hochberg correction. 
This term also refers to an outcome domain in a studied intervention that used a single-case design and demonstrated strong 
or moderate evidence of a negative effect based on the criteria described in version 4.0 of the WWC standards for single- 
case designs (What Works Clearinghouse, 2017). 


Single-case design. A study design in which an outcome is measured repeatedly within and across different conditions that 
are defined by the presence or absence of an intervention. Individuals serve as the unit of intervention and provide their own 
control for purposes of comparison. Examples of single-case designs include multiple baseline designs and alternating 
treatment designs. 


Table B1. Number of interventions that taught each domain, by effect type 


Domain taught 


rd ato) aye) (oy<4[er-]| Print 
Effect type Language awareness knowledge BY =yexeye Tay s4 Early writing 
Effective interventions 30 27 18 3 7 
Inconclusive interventions 53° 15° 22° 2? 4° 
Not effective interventions 3 1 1 0 1 
Interventions without an aligned outcome 26 17 27 6 18 


Note: See box B1 for definitions of effect types. See table B2 for intervention categorization by study design (that is, group design and single-case design). 
a. An effect size could not be calculated with the information provided for two interventions evaluating effectiveness on phonological awareness and for 
one intervention evaluating effectiveness on each of the other domains; therefore, the findings were considered inconclusive. 

Source: Authors’ compilation. 
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Table B2. Number of interventions that taught each domain, by effect type and study design 
Domain taught 


id ao} are) eys4[er-)| Print 
Effect type Language awareness knowledge 1BY=exerelfays4 Early writing 


Group design (n = 118) 


Effective interventions 28 25 17 3 7 
Inconclusive interventions 47° 12? 22° 1? 43 
Not effective interventions 2 1 1 0 1 
Interventions without an aligned outcome 25 17 24 6 18 


Single-case design (n = 14) 
Effective interventions 
Inconclusive interventions 


Not effective interventions 


PIR I|oal]N 
olol|win 
wlolo|pr 
oO}1o|/RIO 
ol1o/o]o 


Interventions without an aligned outcome 


Note: See box B1 for definitions of intervention categorizations. 

a. An effect size could not be calculated with the information provided for two interventions evaluating effectiveness on phonological awareness and for 
one intervention evaluating effectiveness on each of the other domains; therefore, the findings were considered inconclusive. 

Source: Authors’ compilation. 


Table B3. Instructional patterns among the 132 interventions evaluated by high-quality impact studies 
Outcome domain assessed 


Taksivae eiu(oyar-]melo)ear-lial 
taught Number Percent B) 


L only 50 38 49 6 5 
L, PA, & PK 20 15 15 11 12 
L, PA, PK, & W 14 11 
L& PK 13 10 
PA & PK 


PA only 
Taught all areas 
PA, PK, & W 
L&PA 

L&W 

PA, PK, &D 
PK& W 

L, PA, PK, & D 
L, PK, & W 
PA, D, & W 
L&D 


O;yrPIrPIlo;] oy; ;RrPIoIRryFPIT_OIJRPIrPsiI aI Nia 


OINIOITNIOLO]LRP I _ wT _wlsloIyntoan 


OlRFIJOSOINI|RIl[wi]REPlaAlulaltu 
C]TRIRPIOININI[RPIJOlRPI RL OLOl/R IN] A] Uw Ee 


PIP ININININI W]wlwi]ulutloa 
PIP INININININININ]T ARI] BR] UW 
PIlLOTRPIRPIOLSO]WwI]RPIloOITNi|olRPiInia 
OCOlOlOJ/OJOFTOI[RPI PIO TRPIoOo JRPIniIrPlsAI]loO 


fo) 
fo) 
fo) 


Dis decoding. G is general literacy. Lis language. PA is phonological awareness. PK is print knowledge. W is early writing. 

Note: See table B4 for instructional patterns by study design (that is, group design and single-case design). Percentages do not sum to 100 because of 
rounding. 

Source: Authors’ compilation. 


Table B4. Instructional patterns among the 132 interventions evaluated by high-quality impact studies, by 
study design 


Outcome domain assessed 


Taksivaererdtolar-]melolaatelia) 
taught Number Percent ) 


Group design (n = 118) 


Lonly 42 36 41 6 5 6 5 6 
L, PA, & PK 20 17 15 11 12 7 4 4 
L, PA, PK, & W 14 12 6 11 11 5 2 1 
L& PK 12 10 6 5 6 1 1 2 
Taught all areas 5 4 2 4 3 4 4 al 
PA only 4 3 0 4 0 0 0 0 
PA & PK 3 3 1 3 1 0 0 1 
PA, PK, & W 3 3 0 1 3 1 1 0 
L&W 3 3 3 1 0 1 1 1 
PA, PK, & D 2 2 0 2 0 0 2 0 
PK & W 2 2 0 0 2 0 2 0 
L&PA 2 2 1 2 1 0 0 1 
L, PA, PK, & D 2 2 al 0 0 1 0 0 
L, PK, & W 2 2 1 1 2 1 1 0 
PA, D, & W 1 1 0 0 0 0 i 0 
L&D 1 1 1 0 0 0 0 0 
Single-case design (n = 14) 

L only 8 57 8 0 0 0 0 0 
PA & PK 3 21 0 3 1 1 0 0 
PA only 1 7 0 1 0 0 0 0 
L&PA 1 7 0 1 0 0 0 0 
L& PK 1 7 1 0 0 0 0 0 


Dis decoding. G is general literacy. Lis language. PA is phonological awareness. PK is print knowledge. W is early writing. 
Note: Percentages do not sum to 100 because of rounding. 
Source: Authors’ compilation. 


Table B5. Number and percentage of interventions that evaluated effects in each outcome domain among the 
38 interventions that demonstrated effectiveness in at least one outcome domain, by study design 


Group design (n = 34) Single-case design (n = 4) All interventions (n = 38) 
Number of 
Number of interventions interventions 
demonstrating statistically demonstrating strong 
significant positive or moderate Number of effective 

Outcome domain effects Percent evidence of effects Percent interventions Percent 
Language 14 41 2 50 16 42 
Phonological 9 26 2 50 11 29 
awareness 

Print knowledge 12 35 1 25 13 34 
Decoding 6 18 0 0 6 16 
Writing 4 12 0 0 4 11 
General literacy 4 12 0 0 4 11 


Source: Authors’ compilation. 


Figure B1. Flowchart for interventions that taught language exclusively 


Interventions that taught 
language exclusively 


(n = 50) 


Evaluated language Did not evaluate 


language 
(n = 49) 


(n=) 


Used a group design Used a single-case 


design? 
(n= 41) 


(n=8) 


Included sufficient information Did not include sufficient 
to derive an effect size estimate information to derive an effect 


size estimate 
(n = 38) 


(n=3) 


a. In single-case design studies the effect sizes and statistical significance are not estimated; instead, visual analysis is used to evaluate the effectiveness of 
an intervention. Single-case design studies are therefore not included in weighted effect size estimates. 
Source: Authors’ compilation. 


Figure B2. Flowchart for all interventions evaluated by high-quality impact studies 


Interventions that met the evidence standards 


(n = 132) 


Used a group design Used a single-case 


design? 
(n = 118) 


(n= 14) 


Included sufficient Did not include sufficient 
information to derive an information to derive an effect 
effect size estimate size estimate 


(n= 112) (n=6) 


a. In single-case design studies the effect sizes and statistical significance are not estimated; instead, visual analysis is used to evaluate the effectiveness of 
an intervention. Single-case design studies are therefore not included in weighted effect size estimates. 
Source: Authors’ compilation. 


REL 2021-084 B-5 


Table B6. Average weighted effect size on language outcomes among interventions that taught language 
exclusively, by implementation characteristic 


95 percent 
confidence interval? p-value 


Number of Silalel-lac! Lower Upper 
Implementation characteristic interventions Hedges’ g? lagele limit limit 


Intervention type 


Used instructional practices 26 0.43 0.10 0.23 0.63 <.001 
Used lesson packages 3 0.17 0.12 —0.07 0.40 17 
Used curricula 6 0.02 0.07 —0.10 0.15 72 
Used technology program 3 0.16 0.14 —0.12 0.44 .26 
Intervention duration 

Intervention duration less than 2 hours 12 0.49 0.18 0.15 0.84 <.01 
Intervention duration 2-25 hours 19 0.35 0.11 0.15 0.56 <.001 
Intervention duration 25 —50 hours 0 na na na na na 
Intervention duration more than 60 hours 7 0.06 0.06 —0.05 0.17 .29 


Implementer type‘ 


Teacher implemented instruction 13 0.11 0.05 0.02 0.21 .02 
Researcher implemented instruction 18 0.39 0.12 0.16 0.62 <.001 
Other implementer 5 0.20 0.12 -0.04 0.44 10 
Group size 

Used one-on-one or small-group (two to 27 0.43 0.10 0.22 0.63 <.001 
six children) instruction 

Used exclusively large-group’ or whole- 11 0.10 0.05 -0.01 0.20 .06 


class instruction 


Professional development® 


Professional development with ongoing 15 0.20 0.10 0.01 0.39 .04 
support 
Professional development without 6 0.34 0.12 0.11 0.56 <.001 


ongoing support 


na is not applicable. 

Note: Of the 49 interventions that taught and evaluated effectiveness on language exclusively, 38 were evaluated using a group design and included sufficient 
information to derive an effect size estimate and are represented in the table. Of the remaining 11, 8 were evaluated using a single-case design in which 
effect sizes were not estimated, and 3 were evaluated using a group design but did not include sufficient information to derive an effect size estimate. 

a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

c. Two interventions were implemented by the teacher and the researcher and are not represented in the table. 

d. An intervention was coded as using a large group if children were working in groups of more than six and less than 80 percent of the whole class was 
represented. 

e. Two interventions did not provide any professional development, and 15 interventions did not provide sufficient information about professional 
development. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 
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Figure B3. Weighted effect size estimates for untaught outcome domains, by domain taught 
mPAoutcome m®PKoutcome mDoutcome mW outcome 
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Weighted effect size 


PA PK D WPA PK? D WL? PK? D WL? PA D WLP WLP PA PK® D 


Taught L only TaughtL&oneor | Taught PA&oneor Taught PK &oneor Taught D, Taught W & one or 
but not the domain | more other domains more other domains more other domains) PA, & PK more other domains 
listed undereach | but notthedomain but not the domain | but notthe domain butnot but not the domain 
effect size listed under each listed under each listed under each the listed under each 
effect size effect size effect size domain effect size 

listed 

under 

each 

effect size 


Dis decoding. L is language. PA is phonological awareness. PK is print knowledge. W is early writing. 

Note: The error bar represents the 95 percent confidence interval, meaning that there is a 95 percent probability that the “true” effect size lies between the 
lower and upper limits. If the interval includes 0, the weighted mean effect size is not statistically significant. For example, interventions that taught PA and 
one or more other domains but did not teach decoding resulted in a significant weighted effect size of 0.23 on decoding. 

a. A weighted effect size could not be estimated because only one intervention met the referenced criteria. 

b. No interventions met the referenced criteria. 

Source: Authors’ compilation. 


Figure B4. Flowchart for interventions that taught and evaluated effectiveness on language 


Taught and evaluated language 


(n = 86) 


Used a group design Used a single-case 


design? 
(n=77) 


(n=9) 


Included sufficient Did not include sufficient 
information to derive an information to derive an effect 
effect size estimate size estimate 


(n = 74) (n= 3) 


a. In single-case design studies the effect sizes and statistical significance are not estimated; instead, visual analysis is used to evaluate the effectiveness of 
an intervention. Single-case design studies are therefore not included in weighted effect size estimates. 
Source: Authors’ compilation. 
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Figure BS. Presence of shared book reading with or without questions in the 86 interventions that taught and 
evaluated effectiveness on language 
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Source: Authors’ compilation. 


Figure B6. Components of language instruction included in the 86 interventions that taught and evaluated 
effectiveness on language 
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a. Language instruction focused on comprehension always co-occurred with vocabulary instruction. 
b. All but three interventions also included vocabulary instruction. 
Source: Authors’ compilation. 


Table B7. Weighted effect size on language outcomes among interventions that taught and evaluated 
language, by type of outcome measure 


95 percent 
NUBecen Sea confidence interval? 
Type of outcome measure interventions Hedges’ g” lagele Lower limit | Upper limit p-value 
Overall 74 0.19 0.03 0.12 0.25 <.001 
Standardized 53 0.12 0.02 0.07 0.17 <.001 
Researcher-developed 31 0.43 0.09 0.25 0.61 <.001 


Note: Of the 86 interventions that taught and evaluated effectiveness on language, 74 were evaluated using a group design and included sufficient 
information to derive an effect size estimate and are represented in the table. Of the remaining 12, 9 were evaluated using a single-case design in which 
effect sizes were not estimated, and 3 were evaluated using a group design but did not include sufficient information to derive an effect size estimate. 

a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Table B8. Average weighted effect size on language outcomes among interventions that taught and evaluated 
language, by instructional feature 


95 percent 

Number of Siilalel-lac! pee pen id enee ite Nalaew 
Naksiaaeleid(o)ar-] mict-1a0 la) interventions Hedges’ g° lagele Lower limit | Upper limit p-value 
Included any shared book reading 59 0.20 0.04 0.12 0.27 <.001 
Did not include any shared book 15 0.20 0.06 0.07 0.32 .002 
reading 
Included shared book reading with 42 0.26 0.06 0.15 0.37 <.001 
questions 
Included shared book reading 17 0.09 0.04 0.01 0.17 .03 
without questions 
Included both comprehension and 62 0.20 0.04 0.12 0.27 <.001 
vocabulary 
Did not include both comprehension 12 0.14 0.08 —0.01 0.30 .08 
and vocabulary 
Included vocabulary and extending 25 0.26 0.07 0.12 0.40 <.001 
language 
Included vocabulary but not 43 0.15 0.04 0.07 0.22 <.001 


extending language 


Note: Of the 86 interventions that taught and evaluated effectiveness on language, 74 were evaluated using a group design and included sufficient 
information to derive an effect size estimate and are represented in the table. Of the remaining 12, 9 were evaluated using a single-case design in which 
effect sizes were not estimated, and 3 were evaluated using a group design but did not include sufficient information to derive an effect size estimate. 

a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Figure B7. Flowchart for interventions that taught and evaluated effectiveness on phonological awareness 


Taught and evaluated 
phonological awareness 


(n = 43) 


Used a group design Used a single-case 
design? 


(n = 38) 


(n=5) 


Included sufficient Did not include sufficient 
information to derive an information to derive an effect 
effect size estimate size estimate 


(n = 36) (n=2) 


a. In single-case design studies the effect sizes and statistical significance are not estimated; instead, visual analysis is used to evaluate the effectiveness of 
an intervention. Single-case design studies are therefore not included in weighted effect size estimates. 
Source: Authors’ compilation. 


Figure B8. Phonological awareness tasks included in 43 interventions that taught and evaluated effectiveness 
on phonological awareness 
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a. Interventions included two or more of the following tasks: Identification, matching, blending, counting, segmenting, or production. 
Source: Authors’ compilation. 
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Table B9. Average weighted effect size on phonological awareness outcomes, by domain taught 


95 percent 
confidence interval? 
Number of Standard. ©—§ ——_____ 
Domain taught interventions Hedges’ g® error Lower limit | Upper limit p-value 
Phonological awareness 36 0.32 0.04 0.23 0.41 <.001 
Language but not phonological 6 0.02 0.06 -0.10 0.14 73 
awareness 
Language and print knowledge but 7 0.03 0.09 -0.14 0.21 71 


not phonological awareness; 
language and early writing but not 
phonological awareness; or language, 
print knowledge, and early writing 
but not phonological awareness 


a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Table B10. Weighted effect size on phonological awareness outcomes among interventions that taught and 
evaluated phonological awareness, by type of outcome measure 


95 percent 
confidence interval® 
Number of Standard ©—_ ____ 
Type of outcome measure interventions Hedges’ g° error Lower limit | Upper limit p-value 
Standardized 27 0.28 0.04 0.20 0.37 <.001 
Researcher-developed 12 0.43 0.11 0.22 0.64 <.001 


Note: Of the 43 interventions that taught and evaluated effectiveness on phonological awareness, 36 were evaluated using a group design and included 
sufficient information to derive an effect size estimate and are represented in the table. Of the remaining 7, 5 were evaluated using a single-case design in 
which effect sizes were not estimated, and 2 were evaluated using a group design but did not include sufficient information to derive an effect size estimate. 
a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Table B11. Average weighted effect size on phonological awareness outcomes among interventions that 
taught and evaluated phonological awareness, by instructional feature 


95 percent 


confidence interval? 
Number of Standard 


Instructional feature interventions Hedges’ g> lagelg Lower limit Upper limit p-value 


Taught combination‘ of tasks 27 0.38 0.06 0.26 0.50 <.001 


Note: Of the 43 interventions that taught and evaluated effectiveness on phonological awareness, 27 were evaluated using a group design and included 
sufficient information to derive an effect size, provided sufficient information to identify phonological awareness tasks, and are represented in the table. Of 
the remaining 16, 9 interventions were evaluated using a group design and included sufficient information to derive an effect size but either did not provide 
sufficient information to identify any phonological awareness tasks or taught a phonological awareness task that was coded as “other,” 5 were evaluated 
using a single-case design in which effect sizes were not estimated, 2 were evaluated using a group design but did not include sufficient information to derive 
an effect size estimate. 

a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

c. A combination of tasks that includes one or more of the following tasks: identification, matching, blending, counting, segmenting, or production. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Figure B9. Flowchart for interventions that taught and evaluated effectiveness on print knowledge 
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a. In single-case design studies the effect sizes and statistical significance are not estimated; instead, visual analysis is used to evaluate the effectiveness of 
an intervention. Single-case design studies are therefore not included in weighted effect size estimates. 
Source: Authors’ compilation. 
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Figure B10. Print knowledge instructional features included in the 42 interventions that taught and evaluated 
effectiveness on print knowledge 
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Sources: Authors’ compilation. 


Figure B11. Print knowledge instructional materials included in the 42 interventions that taught and evaluated 
effectiveness on print knowledge 
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a. Letter cards are with or without pictures. 
Sources: Authors’ compilation. 


Table B12. Average weighted effect size on print knowledge outcomes, by domain taught 


95 percent 
lite! Ta I? 
Number of Sjm-latel-] ae} ae Ae 
Domain taught interventions Hedges’ g? lagele Lower limit | Upper limit p-value 
Print knowledge 38 0.23 0.05 0.13 0.33 <.001 
Did not teach print knowledge 5 0.10 0.13 -0.15 0.35 45 
Phonological awareness and print 28 0.25 0.06 0.14 0.37 <.001 
knowledge 
Print knowledge but not phonological 10 0.09 0.07 -0.05 0.24 22 
awareness 


a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Table B13. Weighted effect size on print knowledge outcomes among interventions that taught and evaluated 
print knowledge, by type of outcome measure 


95 percent 
confidence interval® 
Number of Standard ©—§_ —_____ 
a AVl-me)melUinxolant-Mantst-K0] a=) interventions Hedges’ g° error Lower limit | Upper limit p-value 
Standardized 19 0.24 0.08 0.09 0.39 <.01 
Researcher-developed 22 0.30 0.08 0.14 0.47 <.001 


Note: Of the 42 interventions that taught and evaluated print knowledge, 38 were evaluated using a group design and included sufficient information to 
derive an effect size estimate and are represented in the table. Of the remaining 4, 2 were evaluated using a single-case design in which effect sizes were 
not estimated, and 2 were evaluated using a group design but did not include sufficient information to derive an effect size estimate. 

a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Table B14. Average weighted effect size on print knowledge outcomes among interventions that taught and 
evaluated print knowledge, by instructional feature 


95 percent 

Niibeter Sean confidence interval 
TaksiaaUoid(olat-] mi-t-1a0| a=) interventions Hedges’ g° lagele Lower limit | Upper limit p-value 
Taught both letter names and letter 23 0.20 0.04 0.12 0.28 <.001 
sounds 
Taught either letter names or letter 9 0.16 0.06 0.03 0.28 01 
sounds but not both 
Taught concepts about print 15 0.32 0.13 0.08 0.57 01 
Did not teach concepts about print 22 0.18 0.04 0.09 0.26 <.001 


Note: Of the 42 interventions that taught and evaluated print knowledge, 38 were evaluated using a group design and included sufficient information to 
derive an effect size estimate and are represented in the table. Of the remaining 4, 2 were evaluated using a single-case design in which effect sizes were 
not estimated, and 2 were evaluated using a group design but did not include sufficient information to derive an effect size estimate. 

a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Figure B12. Flowchart for interventions that taught and evaluated effectiveness on decoding 
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Source: Authors’ compilation. 


Figure B13. Decoding instructional features included in the five interventions that taught and evaluated 
effectiveness on decoding 
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Source: Authors’ compilation. 


Table B15. Average weighted effect size on decoding outcomes, by domain taught 


95 percent 
confidence interval? 


Number of Standard. © 
Domain taught interventions Hedges’ g> lacey s Lower limit | Upper limit p-value 
Decoding, phonological awareness, 4 0.52 0.15 0.22 0.82 <.001 
and print knowledge 
Phonological awareness and print 13 0.22 0.07 0.09 0.36 <.001 


knowledge but not decoding 


a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Table B16. Weighted effect size on decoding outcomes among interventions that taught and evaluated 
decoding, by type of outcome measure 


95 percent 
NuCaeror Sanita confidence interval? 
Type of outcome measure interventions Hedges’ g? error Lower limit | Upper limit p-value 
Standardized 4 0.56 0.17 0.23 0.89 001 
Researcher-developed 2 0.45 0.15 0.16 0.75 <.01 


Note: Of the five interventions that taught and evaluated decoding, four were evaluated using a group design and included sufficient information to derive 
an effect size estimate and are represented in the table. The remaining one was evaluated using a group design but did not include sufficient information to 
derive an effect size estimate. 

a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Figure B14. Flowchart for interventions that taught and evaluated effectiveness on early writing 


Taught and evaluated 
early writing 


(n=12) 
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design 
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(n =0) 
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(n = 11) (n=1) 


Source: Authors’ compilation. 


Figure B15. Early writing instructional features included in the 12 interventions that taught and evaluated 
effectiveness on early writing 
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Source: Authors’ compilation. 
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Table B17. Average weighted effect size on writing outcomes, by domain taught 


95 percent 

NGRReenSr Canard confidence interval 
Domain taught interventions Hedges’ g” error Lower limit | Upper limit p-value 
Early writing 11 0.32 0.13 0.06 0.58 .02 
Early writing, phonological 6 0.41 0.14 0.14 0.69 .003 
awareness, and print knowledge 
Early writing but not phonological 5 0.18 0.24 0.29 0.64 45 
awareness and print knowledge 
Phonological awareness and print 6 0.33 0.09 0.16 0.51 <.001 


knowledge but not early writing 


a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Table B18. Weighted effect size on early writing outcomes among interventions that taught and evaluated 
early writing, by type of outcome measure 


95 percent 
confidence interval? 
Number of Standard. ©—§ ——____. 
Type of outcome measure interventions Hedges’ g® lacey g Lower limit | Upper limit p-value 
Standardized 4 0.23 0.26 0.28 0.75 .37 
Researcher-developed 7 0.36 0.12 0.13 0.59 <.01 


Note: Of the 12 interventions that taught and evaluated early writing, 11 were evaluated using a group design and included sufficient information to derive 
an effect size estimate and are represented in the table. The remaining one was evaluated using a group design but did not include sufficient information to 
derive an effect size estimate. 

a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 


Table B19. Average weighted effect size on early writing outcomes among interventions that taught and 
evaluated early writing, by instructional feature 


95 percent 
: i - 
NU Beeor enters confidence interval 

Instructional feature interventions Hedges’ g” lacey e Lower limit | Upper limit p-value 
Instruction focused on individual 8 0.35 0.13 0.11 0.60 <.01 
letter formation 
Instruction did not focus on individual 2 0.62 0.23 0.17 1.07 <.01 
letter formation 
Instruction focused on whole words 6 0.43 0.15 0.13 0.73 <.01 
in isolation 
Instruction did not focus on whole 4 0.34 0.18 0.02 0.70 .07 


words in isolation 


Note: Of the 12 interventions that taught and evaluated early writing, 10 were evaluated using a group design and included sufficient information to derive 
an effect size estimate, provided sufficient information to identify early writing instructional features, and are represented in the table. Of the remaining 2, 
1 was evaluated using a group design that included sufficient information to derive an effect size but did not provide sufficient information to identify any 
early writing instructional features. and 1 was evaluated using a group design but did not include sufficient information to derive an effect size estimate. 

a. There is a 95 percent probability that the “true” effect size lies between the lower and upper limits. If the interval includes 0, the effect size is not 
statistically significant. 

b. Weighted mean effect size. 

Source: Authors’ analysis of primary data collected for the review; see appendix E. 
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Appendix C. Effects of interventions by domain and type of outcome measure for the 132 interventions evaluated by high- 
quality impact studies 


Table C1. Effects of the 132 interventions evaluated by high-quality impact studies, by outcome domain, type of outcome measure, and study design 


id ao) aye) (oys4[er-]| Print aN General 
Language awareness knowledge Decoding writing literacy 


Intervention 


Group design (n = 118) 


Phonology with Reading (P + R) program (Bowyer-Crane et al., 2008) fe) e e e e e 

Nuffield Early Language Intervention—30 week (Fricke et al., 2013) e e e ° e ° ° 

Jumpstart (Harris, 2010) e o? e e? 
Emergent literacy intervention (Bailet et al., 2009) e e e fe) 
Interactive reading and writing intervention (Thompson, 2015) ° e e ° ° ° 
Funnix Beginning Reading computer program (Stockard, 2009) e fe) fe) e 

Letter manipulation plus articulation (Boyer, 2010) fo) fe) e e 

Head Start REDI (Bierman et al., 2008) e e fe) 

Enriched literacy intervention (Ciancio, 2004) e oe 

Stony Brook Emergent Literacy Project (Massetti, 2009)° e e 

Rhyming/alliteration intervention (Yeh, 2003)? e e 

Integrated Phonics (Smith, 1998) e e 

DLM Early Childhood Express supplemented with Open Court Reading Pre-K (Preschool 

Curriculum Evaluation Research Consortium, 2008h) ° ° ° ° e 
Nuffield Early Language Intervention—30 week (Fricke et al., 2017) e ° ° ° 


Tier 2: Intensive language- and code-focused intervention for children who qualified for 
language-focused or language- and code-focused intervention (study 2) (Lonigan & Phillips, 


2016) e fo) fo) fo) 
Literacy Express Preschool Curriculum plus workshop and in-class mentoring (Lonigan et al., 

2011) fe) fo) e 

PAth to Literacy (Goldstein et al., 2017) fo) e fo) 

Narrative Dynamics and story reenactment (Sa, 2012) e ° 

Educative curriculum material supports (Neuman et al., 2015) e fo) 


v80-T 7202 144 


(6-9) 


id aXe) aye) (oy 4 er-]| Print Early General 
Language awareness knowledge Decoding writing literacy 


Intervention 


Interactive book reading (Wasik & Bond, 2001) e °? 

Professional development on responsivity education (Cabell et al., 2011)? ° e 

Let’s Begin with the Letter People with mentoring (Assel et al., 2007) ° e 

Professional development with media-rich literacy supplement (Penuel et al., 2012) 0? eo 

Writing using iPad and finger (Patchan & Puranik, 2016) fo) e 

Storybook reading with eliciting vocabulary questions (Walsh & Blewitt, 2006) e 

Storybook reading with noneliciting vocabulary questions (Walsh & Blewitt, 2006) e 

Responsive teaching and explicit instruction (Hong & Diamond, 2012)" e 

Storybook reading with questions (Zhou, 2014) e 

Storybook reading with ostensive questions and feedback (Langan, 2010) e 

Explicit expository book reading (Bochna, 2006) e 

Talk Boost (Lee & Pring, 2016) e 

Computer-assisted instruction (Lonigan et al., 2003) e 

Print-focused storybook reading (Justice, 2000) e 

Building Blocks for Literacy with distance mentoring (Lane et al., 2014) e 
Bright Beginnings curriculum (Preschool Curriculum Evaluation Research Consortium, 2008a) fe) fe) fe) fe) fo) 
Creative Curriculum (Preschool Curriculum Evaluation Research Consortium, 2008a) ° ° ° fe) ° 
Creative Curriculum (Preschool Curriculum Evaluation Research Consortium, 2008b) ° ° ° fe) ° 
Curiosity Corner curriculum (Preschool Curriculum Evaluation Research Consortium, 2008d) ° ° ° ° ° 
Language-Focused Curriculum (Preschool Curriculum Evaluation Research Consortium, 2008g) ° ° ° ° O° 


Literacy Express preschool curriculum (Preschool Curriculum Evaluation Research Consortium, 


2008h) fe) fe) fo) fe) fo) 
Nuffield Early Language Intervention—20 week (Fricke et al., 2017) ° ° ° ° 
Ready, Set, Leap! (RMC Research Corporation, 2003) fo) fo) fe) fe) 
Ready, Set, Leap! (Davidson et al., 2009) fo) fo) fe) fe) 
Oral language intervention (L4R) (Haley et al., 2017) fe) fe) fo) fe) 
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ti) 


Intervention 


Tier 2: Code- and language-focused intervention for children who qualified for code-focused 


rd aXe) aye) (oy 4[er-]| 
awareness 


knowledge 


Early 
writing 


or code- and language-focused intervention (study 1) (Lonigan & Phillips, 2016) ° O° 

Dialogic reading and phonological awareness intervention (Lonigan et al., 2013) fe) 

Dialogic reading, phonological awareness, and letter knowledge (Lonigan et al., 2013) ° 

Storybook reading, phonological awareness, and letter knowledge (Lonigan et al., 2013) ° 

Dialogic reading and letter knowledge (Lonigan et al., 2013)” ° 

Let’s Begin with the Letter People (Fischel et al., 2007) ° 
Waterford Early Reading (Fischel et al., 2007) ° 
Literacy Express Preschool Curriculum + Pre-K Mathematics Curriculum + PATHS Explicit 

(Lonigan et al., 2015) fe) 

Literacy Express Preschool Curriculum + Pre-K Mathematics Curriculum + PATHS Implicit 

(Lonigan et al., 2015) fe) 

Phonological awareness training plus letter knowledge training (Pietrangelo, 1999)? 

Stepping Stones to Literacy (Nelson et al., 2009) fo) fe) 

Universal Quality Literacy Practices plus PAVEd for Success program focus on phonological 

awareness and explicit vocabulary enhancement practices (Schwanenflugel et al., 2010)? ° 

Print awareness curriculum plus phonological awareness intervention (Gillis, 1998) ° ° 

Letter name letter sounds intervention (Piasta, 2008) ° ° 

Letter sounds only intervention (Piasta, 2008) fo) fe) 

Explicit emergent literacy intervention (Justice et al., 2003) o? 0? 0? 
Let’s Decode plus Moving on with Literacy (Callcott et al., 2015)” fe) fe) 
Let’s Decode (Callcott et al., 2015) fo) fe) 


Oral language program (Bowyer-Crane et al., 2008) 


Library with additional supports (Neuman, 2017)° 


Story Friends (Kelley et al., 2015) 


Talking buddies (Ruston & Schwanenflugel, 2010) 


Tier 2: Language- and code-focused intervention for children who qualified for language- 
focused or language- and code-focused intervention (study 1) (Lonigan & Phillips, 2016) 
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vO 


id aXe) aye) (oy 4 er-]| Print Early General 
Language awareness knowledge Decoding writing literacy 


Intervention 


At risk Tier 2: Developing Talkers (Zucker et al., 2013) fe) 0? 

Print-focused storybook read aloud with high-dose print referencing (Justice et al., 2010) ° ° 
Imagine Learning (Trotti et al., 2017) fe) fo) 
Waterford Early Learning (Trotti et al., 2017) fe) fo) 
Paper alphabet book reading (Willoughby et al., 2015) ° ° 

Writing using iPad and stylus (Patchan & Puranik, 2016) fo) fe) 
Environmental print (Neumann et al., 2013) fe) fo) 
Morphosyntax intervention (Tyler et al., 2003) ° 

Storybook reading + retelling (Leung, 2008) fe) 

Storybook reading with scaffolding-like questions (study 2) (Blewitt et al., 2009) ° 

Storybook reading with scaffolded questions and feedback (Langan, 2010) ° 

Multimedia story reading with questions (Zhou, 2014) fe) 

Storybook reading with full scaffolded questions and comments (Palmiter, 2013) ° 

Storybook reading with noneliciting vocabulary questions (Walsh, 2009) fe) 

Storybook reading with eliciting vocabulary questions (Walsh, 2009) ° 

Storybook reading with eliciting vocabulary questions with full scaffolded questions and 

comments (Wyant, 2008) fe) 

Storybook reading focusing on narrative (Callihan, 2003) ° 

Digital storybook with interactive features (Kelley & Kinney, 2017) ° 

Ladders to Literacy + Creative Curriculum (Russell, 2005) fo) 

Storybook reading with elaboration (Lima, 2008) °° 

Ready to Learn (Brigman et al., 1999) fe) 

Enhancing language and social skills using evidence-based practices (Esler, 2001)? ° 

Doors to Discovery (Christie et al., 2003)? fe) 

Emergent literacy intervention (Scott, 2005) fe) 

Dialogic reading (Lonigan et al., 1999)? ° 
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Ss" 


Language 


Intervention 


id aXe) aye) (oy 4 er-]| 
awareness 


Print 
knowledge 


1BY=exorel fays4 


Early 
writing 


General 
literacy 


Words of Oral Reading and Language Development (Pollard-Durodola et al., 2011) ° 

Story Friends with embedded lessons (Goldstein et al., 2016) ° 

Literate language intervention (Phillips et al., 2016) fo) 

My Sentence Builder (Washington et al., 2011) fo) 

Nonphonically decodable vocabulary with mixed teaching methods (Price-Mohr & Price, 

2017)? Oo 

Music therapy activities with singing of books (Clouser, 2001)° ° 

Tier 2: Intensive code- and language-focused intervention for children who qualified for code- 

focused or code- and language-focused intervention (study 2) (Lonigan & Phillips, 2016) fe) 

Dialogic reading with emotion-laden storybooks (Mincic, 2009)° 0? 

Phonological awareness training (Majsterek et al., 2000) fe) 

Computer-assisted instruction—Early Reading (Macaruso & Rodman, 2011)° ° 

Rhyme training (Desmond, 2008) ° 

Whole-class phonological awareness training with supplemental small-group instruction 

(Guidry, 2003) fe) 

Creative Curriculum with Ladders to Literacy (Preschool Curriculum Evaluation Research 

Consortium, 2008c)? ° 

CD-ROM (IBM's Stories and More) (Talley et al., 1997) fe) 

eBook reading—Action (Gong & Levy, 2009) fe) 

eBook reading—Bouncing ball (Gong & Levy, 2009) fe) 

eBook reading—Violation (Gong & Levy, 2009) fe) 
Kindergarten Peer Assisted Literacy Strategies and Developing Talkers (Mannes, 2013)? o? 
Doors to Discovery without mentoring (Assel et al., 2007) ° 
Phoneme segmentation training using letters to spell (O’Leary, 2017) ° 
Teaching Early Literacy and Language curriculum (Wilcox et al., 2011)? ° 
Performance-oriented storybook reading (Witt, 2000) ° ° 

Read aloud fiction and nonfiction books (Cesar, 2013) fe) fe) 
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id aXe) aye) (oy s4[er-]| Print Early General 
Language awareness knowledge Decoding writing literacy 


Intervention 


Electronic alphabet book reading (Willoughby et al., 2015)° fe) fe) 
Electronic picturebooks (Allison, 2016) fo) fe) 
Project Approach (Preschool Curriculum Evaluation Research Consortium, 2008i) ° ° ° ° ° 


Single-case design (n = 14) 


Modified PAth to Literacy (Olszewski, 2015) e e 
Book reading and Enhanced Milieu Teaching play (McLeod et al., 2017)" e 

Book reading and play sessions (Stanton-Chapman et al., 2012) e 

Multiple skill phonological awareness instruction (Lovelace, 2008)> e 
Grammatically complete and incomplete prompts to imitate (Bredin-Oja, 2012) ° 

Play sessions (Craig-Unkefer, 1999) fe) 

Peer play (Craig-Unkefer & Kaiser, 2002) fe) 

Milieu teaching strategy (Sheldon, 1997)? ° 

Book reading and play (Stanton-Chapman, 2004) ° 

Video self-modeling (Whitlow, 2003) fo) 

Phonological awareness instruction (Hsin, 2007) ° ° 
Phonological awareness intervention (Kruse, 2013)° ° 

Phonological awareness intervention (first sound identification) (Noe et al., 2014)” fe) 


iPad instruction of target verb (Dennis et al., 2016) 


e is effective (see box B1). 

oO is inconclusive (see box B1). 

dis not effective (see box B1). 

RD is researcher-developed outcome. 

S is standardized outcome. 

Note: See appendix F for the complete citation associated with each study evaluating the interventions. 

a. There is not enough information provided in the manuscript to calculate effect size. 

b. Study was rated as a high-quality quasi-experimental study as opposed to a high-quality experimental study. 
Source: Authors’ compilation. 
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Appendix D. Implementation characteristics of the 132 interventions evaluated by high-quality impact studies 


Table D1. Implementation characteristics of the 132 interventions evaluated by high-quality impact studies, by study design and intervention type 
Taksiaableid(o)ar-) mele) nat-lia} Implementation 


Ke} i) 


Taide lead (ola) Lesson ale=1aVc-10 en od (0) od DN ©) a 40) af 2 
Intervention name Grouping — Intensity and duration (hours) plan -tionist provided support 


Group design (n = 118) 


Curriculum 

At risk Tier 2: Developing Talkers (Zucker et al., W,S 30 minute sessions, 2-25 Vv Vv T Vv Vv 

2013) 10 sessions per week 
for 4 weeks 

Bright Beginnings curriculum (Preschool Ww 5 sessions per week More than v T v Vv 

Curriculum Evaluation Research Consortium, for whole school year 60 

2008a) 

Creative Curriculum (Preschool Curriculum Ww 5 sessions per week More than Vv T Vv Vv 

Evaluation Research Consortium, 2008a) for whole school year 60 

Creative Curriculum (Preschool Curriculum WwW 5 sessions per week More than Vv T Vv Vv 

Evaluation Research Consortium, 2008b) for whole school year 60 

Curiosity Corner curriculum (Preschool Ww 5 sessions per week More than Vv T Vv Vv 

Curriculum Evaluation Research Consortium, for whole school year 60 

2008d) 

DLM Early Childhood Express supplemented WwW 5 sessions per week More than Vv Vv Vv T Vv Vv 

with Open Court Reading Pre-K (Preschool for whole school year 60 

Curriculum Evaluation Research Consortium, 

2008h) 

Doors to Discovery (Christie et al., 2003) W,S 5 sessions per week 2-25 Vv Vv Vv Vv T Vv Vv 
for 12 weeks 

Doors to Discovery without mentoring (Assel W, S, | Whole school year More than Vv Vv Vv Vv Vv T Vv Vv 

et al., 2007) 60 

Head Start REDI (Bierman et al., 2008) W,| 3-4 sessions per week More than v Vv Vv Vv T,O Vv Vv 
for 25 weeks 60 

Language-Focused Curriculum (Preschool Ww Whole school year More than Vv T Vv Vv 

Curriculum Evaluation Research Consortium, 60 

2008g) 


Implementation 


Taksivae Keiu(oyar-]melo)aat-l ial 


Total 
Taide lead (ola) Lesson Interven PriorPD Ongoing 

Intervention name Grouping _ Intensity and duration (hours) WwW plan -tionist provided support 
Let’s Begin with the Letter People (Fischel et w,L,S Whole school year More than Vv Vv Vv Vv T Vv Vv 
al., 2007) 60 
Let’s Begin with the Letter People with W, S, | 26 weeks More than T Vv Vv 
mentoring (Assel et al., 2007) 60 
Literacy Express Preschool Curriculum Ww,L,S 5 sessions per week More than T Vv Vv 
(Preschool Curriculum Evaluation Research for whole school year 60 
Consortium, 2008h) 
Literacy Express Preschool Curriculum plus L,S Whole school year More than T Vv Vv 
workshop and in-class mentoring (Lonigan et 60 
al., 2011) 
Phonology with Reading (P + R) program S, | 25 minute sessions, 25-50 T Vv Vv 
(Bowyer-Crane et al., 2008) 5 sessions per week 

for 20 weeks 
Ready, Set, Leap! (Davidson et al., 2009) W, S, | 90 minute per day for More than T, TECH+ Vv Vv 

the whole school year 60 
Ready, Set, Leap! (RMC Research Corporation, | Whole school year More than TECH 
2003) 60 
Stepping Stones to Literacy (Nelson et al., S 20 minute sessions, 2-25 O Vv Vv 
2009) 2-3 sessions per week 

for 10 weeks 
Teaching Early Literacy and Language L,S 150 minute sessions, More than T Vv Vv 
curriculum (Wilcox et al., 2011) 4 sessions per week 60 

for 40 weeks 
Waterford Early Reading (Fischel et al., 2007) L,S,1 15 minute sessions, 25-50 T, TECH Vv Vv 


116 sessions in 
30 weeks 


Naksiaab(eid(o)ar-) mele) ear-lia} Implementation 


Total 
Taide lead (ola) Lesson Tah <=1 a=) 0 od (0) od DN ©) a Xe) af 2 
Intervention name Grouping _ Intensity and duration (hours) plan dole iano ce) U0 (=e MU] ) ole] a 


Instructional practice 


Dialogic reading (Lonigan et al., 1999) S 10-15 minute 2-25 Vv R Vv Vv 
sessions, 4—5 sessions 
per week for 6 weeks 


Dialogic reading and letter knowledge S 15 minute sessions, 25-50 Vv Vv R Vv Vv 
(Lonigan et al., 2013) 5 sessions per week 

for 32 weeks 
Dialogic reading and phonological awareness S 15 minute sessions, 25-50 Vv Vv R Vv Vv 
intervention (Lonigan et al., 2013) 5 sessions per week 

for 32 weeks 
Dialogic reading with emotion-laden S 10-15 minute 2-25 v Vv T Vv Vv 
storybooks (Mincic, 2009) sessions, 3 sessions 

per week for 12 weeks 
Dialogic reading, phonological awareness, and S 15 minute sessions, 25-50 Vv Vv Vv R Vv Vv 
letter knowledge (Lonigan et al., 2013) 5 sessions per week 

for 32 weeks 
Educative curriculum material supports Ww 10-15 minute 2-25 Vv Vv T Vv Vv 
(Neuman et al., 2015) sessions, 5 sessions 

per week for 12 weeks 
Electronic alphabet book reading (Willoughby S 20 minute sessions, 2-25 Vv Vv Vv Vv R, U U 
et al., 2015) 2 sessions per week TECH+ 

for 8 weeks 
Emergent Literacy intervention (Bailet et al., S, | 30 minute sessions, 2-25 Vv Vv Vv Vv Vv R,O Vv Vv 
2009) 2 sessions per week 

for 9 weeks 
Emergent literacy intervention (Scott, 2005) W 15-20 minute 2-25 Vv Vv Vv Vv v T Vv Vv 


sessions, 4 sessions 
per week for 12 weeks 


Enhancing language and social skills using L,S, 1 5 sessions per week 25-50 Vv Vv T Vv Vv 
evidence-based practices (Esler, 2001) for 18 weeks 


Enriched literacy intervention (Ciancio, 2004) I 15 sessions 2-25 Vv Vv Vv R Vv 


Taksivae Keiu(oyar-]melo)aat-l ial 


Implementation 


Total 
instruction Lesson ah X=1aV.-10 an oa (0) od DN ©) a Xe) af 2 
Intervention name Grouping _ Intensity and duration (hours) plan -tionist provided support 
Environmental print (Neumann et al., 2013) S 30 minute sessions, 2-25 Vv Vv R U U 
1 session per week 
for 8 weeks 
Explicit emergent literacy intervention (Justice S 30 minute sessions, 2-25 Vv Vv Vv O Vv Vv 
et al., 2003) 2 sessions per week 
for 6 weeks 
Explicit expository book reading (Bochna, S 11 minute sessions, 2-25 Vv R 
2006) 14 sessions in 5 weeks 
Interactive book reading (Wasik & Bond, 2001) W,S 4 sessions per week 2-25 Vv R, T Vv Vv 
for 15 weeks 
Interactive reading and writing intervention L, 20-25 minute 2-25 Vv Vv Vv Vv T Vv Vv 
(Thompson, 2015) sessions, 4 sessions 
per week for 13 weeks 
Jumpstart (Harris, 2010) S, | 4 hours per week More than O Vv 
for 30 weeks 60 
Letter manipulation plus articulation (Boyer, | 2.48 hours on average 2-25 Vv Vv Vv R U U 
2010) 
Letter name letter sounds intervention (Piasta, S 10-15 minute 2-25 Vv Vv Vv R Vv Vv 
2008) sessions, 3-4 sessions 
per week for 8 weeks 
Letter sounds only intervention (Piasta, 2008) S 10-15 minute 2-25 Vv Vv Vv R Vv Vv 
sessions, 3—4 sessions 
per week for 8 weeks 
Library with additional supports (Neuman, W,| Whole school year More than T,O Vv Vv 
2017) 60 
Literate language intervention (Phillips et al., S 20-25 minute 2-25 Vv R Vv Vv 
2016) sessions, 3-4 sessions 
per week for 12 weeks 
Morphosyntax intervention (Tyler et al., 2003) S, | 35-40 minute 2-25 v O Vv 


sessions, 2 sessions 
per week for 12 weeks 


Taksivae Ceiu(oyer-]melolaat-l ial 


Implementation 


Total 
Taide led (ola) Lesson a=) aVc-10 en od (0) od DN ©) a Xe) a 2 

Intervention name Grouping _ Intensity and duration (hours) plan -tionist provided support 
Multimedia story reading with questions | 2 sessions in 2 weeks Less than 2 R, U U 
(Zhou, 2014) TECH+ 
Music therapy activities with singing of books L 20 minute sessions, 2-25 Vv O 
(Clouser, 2001) 4 sessions per week 

for 4 weeks 
My Sentence Builder (Washington et al., 2011) | 20 minute sessions, 2-25 R, U U 

1 session per week TECH+ 

for 10 weeks 
Narrative Dynamics and story reenactment S 25 minute sessions, 2-25 Vv R U U 
(Sa, 2012) 2 sessions per week 

for 8 weeks 
Nonphonically decodable vocabulary with Ww Whole school year More than Vv Vv T Vv Vv 
mixed teaching methods (Price-Mohr & Price, 60 
2017) 
Paper alphabet book reading (Willoughby et S 20 minute sessions, 2-25 Vv Vv R U U 
al., 2015) 2 sessions per week 

for 8 weeks 
Performance-oriented storybook reading S 30 minute sessions, 2-25 Vv R U U 
(Witt, 2000) 3 sessions per week 

for 6 weeks 
Phoneme segmentation training using letters | 1 session for Less than 2 Vv Vv R U U 
to spell (O’Leary, 2017) 15 minutes 
Phonological awareness training (Majsterek et Ww 10 minute sessions, Less than 2 Vv R 
al., 2000) 9 sessions in 4 weeks 
Phonological awareness training plus letter W,S, 30-35 minute More than Vv Vv Vv Vv T Vv Vv 
knowledge training (Pietrangelo, 1999) sessions, 22 sessions 60 

per week for 12 weeks 
Print awareness curriculum plus phonological S, | 10-15 minute 2-25 Vv v R U U 
awareness intervention (Gillis, 1998) sessions, 2 sessions 

per week for 12 weeks 
Print-focused storybook read aloud with high- W 4 sessions per week More than v Vv T v Vv 
dose print referencing (Justice et al., 2010) for 30 weeks 60 


Taksinae ceid(oyar-]melo)aat-l ial 


Implementation 


Total 
aside lead (ola) Lesson ah X=1aV.-10 an oa (0) od DN ©) a Xe) af 2 

Intervention name Grouping _ Intensity and duration (hours) plan -tionist provided support 
Print-focused storybook reading (Justice, S 5 minute sessions, 2-25 Vv Vv Vv R U U 
2000) 3 sessions per week 

for 8 weeks 
Professional development on responsivity WwW 24 weeks More than Vv T Vv Vv 
education (Cabell et al., 2011) 60 
Professional development with media-rich W,S, | 34 minute sessions, 2-25 Vv Vv Vv Vv Vv R, T Vv Vv 
literacy supplement (Penuel et al., 2012) 5 sessions per week 

for 10 weeks 
Project Approach (Preschool Curriculum w,sS 50-55 minute More than Vv Vv T Vv Vv 
Evaluation Research Consortium, 2008i) sessions, 5 sessions 60 

per week for whole 

school year 
Read aloud with fiction and nonfiction books WwW 8 sessions in 8 weeks 2-25 Vv Vv Vv R U U 
(Cesar, 2013) 
Ready to Learn (Brigman et al., 1999) WwW 2 hours per week 2-25 Vv T Vv Vv 

for 12 weeks 
Responsive teaching and explicit instruction S 15 minute sessions, Less than 2 Vv Vv Vv R U U 
(Hong & Diamond, 2012) 4 sessions in 2-3 

weeks 
Rhyme training (Desmond, 2008) S 15 minute sessions, 2-25 Vv Vv T U U 

4 sessions per week 

for 7 weeks 
Rhyming/alliteration intervention (Yeh, 2003) S 20-25 minute 2-25 Vv Vv Vv T Vv 

sessions, 2 sessions 

per week for 9 weeks 
Storybook reading + retelling (Leung, 2008) S, | 3 sessions per week 2-25 Vv Vv R,T Vv 

for 4 weeks 
Storybook reading focusing on narrative S 35 minute sessions, 2-25 Vv Vv R Vv 
(Callihan, 2003) 2 sessions per week 

for 10 weeks 
Storybook reading with elaboration (Lima, WwW 3 sessions in 1 week Less than 2 Vv Vv T Vv 


2008) 


Taksivae Keiu(oyar-]melo)aat-l ial 


Implementation 


Total 
aside lead (ola) Lesson Tah <=1aV.-10 ann od (0) od DN ©) a 40) a 2 
Intervention name Intensity and duration (hours) plan -tionist provided support 
Storybook reading with eliciting vocabulary 4 sessions in 6 weeks Less than 2 Vv R U U 
questions (Walsh & Blewitt, 2006) 
Storybook reading with eliciting vocabulary 4 sessions in 6 weeks Less than 2 Vv R Vv 
questions (Walsh, 2009) 
Storybook reading with eliciting vocabulary 1 session per week Less than 2 Vv R U U 
questions with full scaffolded questions and for 3 weeks 
comments (Wyant, 2008) 
Storybook reading with full scaffolded 2 sessions in 2 weeks Less than 2 Vv R U U 
questions and comments (Palmiter, 2013) 
Storybook reading with noneliciting 4 sessions in 6 weeks Less than 2 Vv R U U 
vocabulary questions (Walsh & Blewitt, 2006) 
Storybook reading with noneliciting 4 sessions in 6 weeks Less than 2 Vv R Vv 
vocabulary questions (Walsh, 2009) 
Storybook reading with ostensive questions 2 sessions Less than 2 R U U 
and feedback (Langan, 2010) 
Storybook reading with questions (Zhou, 2014) 2 sessions in 2 weeks Less than 2 R 
Storybook reading with scaffolded questions 2 sessions Less than 2 Vv R 
and feedback (Langan, 2010) 
Storybook reading with scaffolding-like 4 sessions Less than 2 Vv R U U 
questions (study 2) (Blewitt et al., 2009) 
Storybook reading, phonological awareness, 15 minute sessions, 25-50 Vv Vv R Vv Vv 
and letter knowledge (Lonigan et al., 2013) 5 sessions per week 
for 32 weeks 
Talking buddies (Ruston & Schwanenflugel, 25 minute sessions, 2-25 R Vv Vv 
2010) 2 sessions per week 
for 10 weeks 
Tier 2: Code- and language-focused 40 minute sessions, 25-50 Vv Vv Vv R Vv Vv 


intervention for children who qualified for 
code-focused or code- and language-focused 
intervention (study 1) (Lonigan & Phillips, 
2016) 


4 sessions per week 
for 11 weeks 


Nakina Ulead fo)ar-) mele) ear-lia} Implementation 


Total 
instruction Lesson Interven PriorPD Ongoing 
Intervention name Grouping _ Intensity and duration (hours) plan -tionist provided support 
Tier 2: Intensive code- and language-focused S 40 minute sessions, 25-50 Vv Vv v Vv R Vv Vv 
intervention for children who qualified for 4 sessions per week 
code-focused or code- and language-focused for 11 weeks 


intervention (study 2) 
(Lonigan & Phillips, 2016) 


Tier 2: Intensive language- and code-focused S 40 minute sessions, 25-50 Vv Vv Vv Vv R Vv Vv 
intervention for children who qualified for 4 sessions per week 

language-focused or language- and code- for 11 weeks 

focused intervention (study 2) (Lonigan & 

Phillips, 2016) 

Tier 2: Language- and code-focused S 40 minute sessions, 25-50 Vv Vv Vv Vv R Vv Vv 
intervention for children who qualified for 4 sessions per week 

language-focused or language- and code- for 11 weeks 

focused intervention (study 1) (Lonigan & 

Phillips, 2016) 

Universal Quality Literacy Practices plus PAVEd w,S Whole school year More than Vv Vv Vv Vv T Vv Vv 
for Success program focus on phonological 60 


awareness and explicit vocabulary 
enhancement practices (Schwanenflugel et al., 


2010) 
Whole-class phonological awareness training w,S 15-20 minute sessions, 2-25 Vv R U U 
with supplemental small-group instruction 4—5 sessions per week 
(Guidry, 2003) for 6 weeks 
Writing using iPad and finger (Patchan & S 20 minute sessions, 2-25 Vv Vv R U U 
Puranik, 2016) 3 sessions per week 

for 8 weeks 
Writing using iPad and stylus (Patchan & Ss 20 minute sessions, 2-25 Vv Vv R U U 
Puranik, 2016) 3 sessions per week 


for 8 weeks 


Taiw=davcevahdcolamar-laate) 


Lesson package 


Grouping 


Taimetakiiavarclale mel) e-lutoya 


Ke) i) 
Nalsiavlod (ola) 
(hours) 


Taksinae (eidfovar-]melo)aat-l ial 


=e) 9) 
plan 


Implementation 


Interven 
-tionist 


Prior PD 
provided 


Ongoing 
support 


Building Blocks for Literacy with distance Ww 6 months 2-25 Vv Vv Vv Vv T Vv Vv 
mentoring (Lane et al., 2014) 
Creative Curriculum with Ladders to Literacy WwW 5 sessions per week More than Vv Vv T Vv Vv 
(Preschool Curriculum Evaluation Research for whole school year 60 
Consortium, 2008c) 
Integrated Phonics (Smith, 1998) W, 5S, | 20 weeks More than Vv Vv Vv Vv Vv Vv T U U 
60 
Kindergarten Peer Assisted Literacy Strategies L,S 35-40 minute 25-50 Vv Vv Vv Vv Vv T Vv Vv 
and Developing Talkers (Mannes, 2013) sessions, 4 sessions 
per week for 12 weeks 
Ladders to Literacy + Creative Curriculum WwW Whole school year More than Vv Vv Vv Vv T Vv Vv 
(Russell, 2005) 60 
Let’s Decode (Callcott et al., 2015) Ww, 15 minute sessions, More than Vv Vv Vv Vv T Vv Vv 
5 sessions per week 60 
for whole school year 
Let’s Decode plus Moving on with Literacy W,S, 30 minute sessions, More than Vv Vv Vv Vv T Vv Vv 
(Callcott et al., 2015) 5 sessions per week 60 
for whole school year 
Literacy Express Preschool Curriculum + Pre-K w,S Whole school year More than Vv Vv Vv Vv Vv T Vv Vv 
Mathematics Curriculum + PATHS Explicit 60 
(Lonigan et al., 2015) 
Literacy Express Preschool Curriculum + Pre-K w,S Whole school year More than Vv Vv Vv Vv Vv T Vv Vv 
Mathematics Curriculum + PATHS Implicit 60 
(Lonigan et al., 2015) 
Nuffield Early Language Intervention—30 S, | 45 minutes per week, 25-50 Vv Vv Vv Vv T Vv Vv 


week (Fricke et al., 2013) 


for 10 weeks then 120 
minutes per week 
for 20 weeks 


Taksivae Keiu(oyar-]melo)aat-l ial 


Implementation 


Total 
instruction Lesson Interven PriorPD Ongoing 

Intervention name Grouping — Intensity and duration (hours) plan -tionist provided support 
Nuffield Early Language Intervention—30 S, | 45 minutes per week 25-50 Vv T Vv Vv 
week (Fricke et al., 2017) for 10 weeks then 

120 minutes per week 

for 20 weeks 
Nuffield Early Language Intervention—20 S, | 120 minutes per week 25-50 Vv T Vv Vv 
week (Fricke et al., 2017) for 20 weeks 
Oral language program (Bowyer-Crane et al., S, | 25 minute sessions, 25-50 Vv T Vv Vv 
2008) 5 sessions per week 

for 20 weeks 
Oral language intervention (L4R) (Haley et al., Ww 20 minute sessions, 2-25 Vv T Vv Vv 
2017) 3 sessions per week 

for 15 weeks 
PAth to Literacy (Goldstein et al., 2017) S 10 minute sessions, 2-25 Vv T Vv Vv 

29 sessions in 15 

weeks 
Stony Brook Emergent Literacy Project Ww Whole school year More than v T Vv v 
(Massetti, 2009) 60 
Talk Boost (Lee & Pring, 2016) w,s 30 minute sessions, 2-25 Vv T,O Vv 

3 sessions per week 

for 10 weeks 
Words of Oral Reading and Language L 15-20 minute 2-25 Vv T Vv Vv 
Development (Pollard-Durodola et al., 2011) sessions, 5 sessions 

per week for 12 weeks 
Technology program 
Computer-assisted instruction—Early Reading | 10 minute sessions, 2-25 TECH Vv 
(Macaruso & Rodman, 2011) 20 sessions 
CD-ROM (IBM's Stories and More) (Talley et S 10-15 minute 2-25 TECH+ U U 
al., 1997) sessions, 12 sessions 

total 
Computer-assisted instruction (Lonigan et al., I 3-4 sessions per week 2-25 TECH+ U U 


2003) 


for 8 weeks 


Nakina Ulead fo)ar-) mele) ear-lia} Implementation 


Total 
instruction Lesson Interven PriorPD Ongoing 

Vah=avcclahitelaMar-]aat Grouping _ Intensity and duration (hours) plan -tionist provided support 
Digital storybook with interactive features I 3 sessions in 2 weeks Less than 2 Vv Vv TECH+ U U 
(Kelley & Kinney, 2017) 
eBook reading—Action (Gong & Levy, 2009) | 12-15 minute Lessthan2 Vv Vv TECH+ U U 

sessions, 6 sessions in 

4 weeks 
eBook reading—Bouncing ball (Gong & Levy, | 10-15 minute Less than 2 Vv Vv TECH+ U U 
2009) sessions, 6 sessions in 

4 weeks 
eBook reading—Violation (Gong & Levy, 2009) I 11-15 minute Less than 2 v v TECH+ U U 

sessions, 6 sessions in 

4 weeks 
Electronic picturebooks (Allison, 2016) | 12 weeks 25-50 Vv Vv TECH 
Funnix Beginning Reading computer program I 30 minute sessions, More than Vv Vv Vv Vv Vv Vv TECH+ Vv Vv 
(Stockard, 2009) 5 sessions per week 60 


for 32 weeks 


Imagine Learning (Trotti et al., 2017) I 15 minute sessions, 2-25 Vv Vv TECH U U 
5 sessions per week 
for 16 weeks 


Story Friends (Kelley et al., 2015) | 8-10 minute sessions, 2-25 Vv TECH+ U U 
3-4 sessions per week 
for 12 weeks 


Story Friends with embedded lessons I 9-12 minute sessions, 2-25 Vv TECH+ U U 
(Goldstein et al., 2016) 1-3 sessions per week 

for 26 weeks 
Waterford Early Learning (Trotti et al., 2017) I 15 minute sessions, 2-25 Vv Vv TECH U U 


5 sessions per week 
for 16 weeks 


Tain=davcelahdcolamar-laatc) 


Single-case design (n = 14) 


Grouping 


Total 
Takidae (eid (eya) 
Taielakiiavarclalemelele-latoya (hours) 


Taksivae ceid(oyar-]melo)aat-) ial 


Lesson 
plan 


Tanvolcdant-Vaie-latoya 


Interven 
-tionist 


Prior PD 
recente l=te| 


Ongoing 
support 


Instructional practice 


Book reading and Enhanced Milieu Teaching I 20 minute sessions, 2-25 R U U 
play (McLeod et al., 2017) 13-21 sessions 
Book reading and play (Stanton-Chapman, S 30 minute sessions, 2-25 Vv R Vv 
2004) 11 sessions 
Book reading and play sessions (Stanton- S 20-25 minute sessions, 2-25 R U U 
Chapman et al., 2012) 15 sessions 
Grammatically complete and incomplete | 25 minute sessions, 2-25 R U U 
prompts to imitate (Bredin-Oja, 2012) 7 sessions 
iPad instruction of target verb (Dennis et al., S, | 10 minute sessions, 2-25 Vv R v 
2016) 7 sessions in 7 weeks 
Milieu teaching strategy (Sheldon, 1997) | 10 minute sessions, 2-25 Vv R U U 
23 sessions in 
12 weeks 
Modified PAth to Literacy (Olszewski, 2015) | 3-16 sessions 2-25 Vv Vv Vv R Vv Vv 
Multiple skill phonological awareness I 4—11 sessions 2-25 v R Vv 
instruction (Lovelace, 2008) 
Peer play (Craig-Unkefer & Kaiser, 2002) S 20 minute sessions, 2-25 R U U 
14 sessions in 9 weeks 
Phonological awareness instruction (Hsin, | 15 minute sessions, 2-25 Vv Vv Vv R Vv 
2007) 23 sessions in 5 weeks 
Phonological awareness intervention (first S 15-20 minute 2-25 Vv Vv R Vv 
sound identification) (Noe et al., 2014) sessions, 24 sessions 
in 8 weeks 
Phonological awareness intervention (Kruse, S 10-15 minute sessions, 2-25 Vv Vv Vv R Vv 
2013) 26-36 sessions 
in 12.5 weeks 
Play Sessions (Craig-Unkefer, 1999) S 18 minute sessions, 2-25 R Vv 


17 sessions 


TaksiaaU(eid(o)ar-) mele) ear-lia} Implementation 


aie)i}| 
aside lad (ola) Lesson a <=1aVc-10 en od (0) oo DN ©) a Xo) a 2 
Intervention name Grouping — Intensity and duration (hours) plan -tionist provided support 
Technology program 
Video self-modeling (Whitlow, 2003) | 4 sessions Less than 2 Vv TECH+ U U 


Grouping: | is one on one, L is large group, S is small group, W is whole class. 
Instructional domain: D is decoding, L is language, PA is phonological awareness, PK is print knowledge, W is early writing. 


Interventionist: O is speech-language pathologist, paraprofessional, volunteer, or parent; R is researcher; T is teacher; TECH is technology; TECH+ is technology with adult supervision. 
Prior professional development (PD) provided: U is unknown. 


Ongoing support: U is unknown. 
Source: Authors’ compilation. 


Appendix E. Research basis for the 109 high-quality impact studies 


Table E1. Research basis for the 95 group design studies that the study team determined met the evidence standards 


Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Allison, J. C. (2016). Electronic Cluster — Electronic Business as 67 students PA S GRTR: Phonological 0.07 
picture books: Do they support the RCT picturebooks usual in 4 childcare awareness 
construction of print knowledge in centers PK S GRTR: Print ~0.26 
young emergent literacy learners? knowledge 
(Order No. 10193515) [Doctoral 
dissertation, Temple University]. 
ProQuest Dissertations & Theses 
database. 
Assel, M. A., Landry, S.H., Swank, P. Cluster = Let’s Begin with Business as 261 students L S Preschool Language 0.02 
R., & Gunnewig, S. (2007). An RCT the Letter usual in 13 schools Scale-IV: Auditory 
evaluation of curriculum, setting, People with comprehension 
and mentoring on the performance mentoring 


Expressive Vocabulary —0.10 
Test: Expressive 
vocabulary and word 


of children enrolled in pre- 
kindergarten. Reading and Writing, 
20(5), 463-494. 


: : retrieval 
https://eric.ed.gov/?id=EJ7 74756. 
259 students D S WJ: Letter-word 0.34 ° 
in 13 schools identification 
Doors to Business as 270 students D S WJ: Letter-word —0.08 
Discovery usual in 13 schools identification 


without 
mentoring 


NEL R Me) Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Bailet, L. L., Repper, K. K., Piasta, S. Cluster Emergent Business as About L S Year 1 GGG: Picture 0.47 <r 
B., & Murphy, S. P. (2009). Emergent RCT literacy usual 185 students naming 
pts intervention for intervention in 38 sila Year 2 TOPEL: 0.03 
pre indergarteners at risk for presc ool and Vocabulary 
reading failure. Journal of Learning childcare centers 
Disabilities, 42(4), 336-355. in year 1; PA Year 1 GGG: 0.45 a 
https://eric.ed.gov/?id=EJ843696. about Alliteration 
252 students Year 1 GGG: Rhyming 0.38 
in 72 privat 
eS Year 2TOPEL:Elision 0.02 
preschool and 
childcare centers Year 2 TOPEL: 0.23 
in year 2; Blending 
about Year 3 TOPEL: Elision 0.09 
370 students = 
in 102 private Year 3 TOPEL: 0.35 
preschool and Blending 
childcare centers Year 3 Assessment of 0.24 
in year 3 Literacy and 
Language: Rhyme 
knowledge 
PK Year 2 TOPEL: Print 0.48 = 
knowledge 
Year 3 TOPEL: Print 0.12 
knowledge 
G Year 1 GRTR 0.38 
Year 2 GRTR 0.28 
Year 3 GRTR 0.22 


NEL R ei Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Bierman, K. L., Domitrovich, C. E., Cluster Head Start Business as 336 students L S EOWPVT 0.18 
Nix, R. L., Gest, S. D., Welsh, JA, RCT REDI usual in 44 Head Start TOLD=sGrammatical 0.28 * 
Greenberg, M. T., Blair, C., Nelson, classrooms understanding 
K.E., & Gill, S. (2008). Promoting 
academic and social-emotional TOLD: Sentence —0.13 
school readiness: The head start imitation 
REDI program. Child Development, PA S TOPEL: Blending 0.37 AK 
79(6), 1802-1817. eee n 
https://eric.ed.gov/?id=EJ818718. TORED ESN Ope 
PK S TOPEL: Print 0.11 
knowledge 
Blewitt, P., Rump, K. M., Shealy, S. RCT Storybook Storybook 33 students L RD New Word 0.11 
E., & Cook, S. A. (2009). Shared book reading with reading with — in 4 preschools Comprehension Test 
reading: When and how questions scaffolding-like scaffolding- Raw Word Definition 0.76 
affect young children’s word questions like Tae 
learning. Journal of Educational (study 2) questions 
Psychology, 101(2), 294. 
https://eric.ed.gov/?id=EJ835037. 
Bochna, C. R. (2006). The impact of RCT Explicit Storybook 36 students L RD Main idea free recall —0.02 
instruction in text structure on expository reading in 3 Head Start Main idea prompted 0.22 
listening comprehension in book reading centers recall 
preschool age students (UMI No. : . 
3378045) [Doctoral dissertation, The Topic prompted recall 1.35 


Pennsylvania State University]). 
ProQuest Dissertations & Theses 
database. 


NEL R Me) Effect Significant 


Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Bowyer-Crane, C., Snowling, M. J., RCT Phonology with Oral 142 students PA RD Sound isolation task— 0.10 
Duff, F.J., Fieldsend, E., Carroll, J. Reading (P+R) language in 19 schools initial phoneme 
M., Miles, J., Gotz, C., & Hulme, C. program program component 


(2008). Improving early language 
and literacy skills: Differential 
effects of an oral language versus a 
phonology with reading 


S TOPA: Phoneme 0.82 nae 
segmentation, 
blending, deletion 


intervention. Journal of Child Phonological abilities 0.22 
Psychology and Psychiatry, 49(4), test 
422-432. PK RD Letter identification 0.42 * 
https: ic.ed.gov/?id=EJ812879. 
aie D RD Prose reading 0.44 ies 
accuracy 
S Early Word 0.43 . 
Recognition Test 
W RD Spelling items correct 0.50 ae 
Spelling percent 0.25 
consonants correct 
Oral language Phonology 142 students LL RD Listening 0.11 
program with in 19 schools comprehension 
Reading (P + S APT: Grammar 0.38 
R) program 
The Bus Story: 0.30 
Average sentence 
length 
The Bus Story: 0.24 


Narrative skill 


Nature of 
comparison 
group 


Effect Significant 
size for after B-H 
measure correction 


Outcome Outcome 
domain type 


Intervention 


Citation name Outcome measure 


Analysis sample 


v80-TZ0¢ 144 


Boyer, N. E. (2010). Phonemic RCT Letter Letter 40 students PA RD Phoneme 0.70 
awareness instruction: Effects of manipulation manipulatio —_in 6 classrooms segmentation—words 
letter manipulation and articulation plus = n only in2 ean phoneme 0.54 
training on learning to read and articulation preschools segmentation— 
spell (UMI No. 3426368) [Doctoral sounds 
dissertation, The City University of 
New York]. ProQuest Dissertations & PK RD Letter-sound task 0.32 
Theses database. D RD Nonword reading task 0.84 * 
RD Developmental 0.81 al 
spelling task— 
nonwords 
Developmental 0.85 ss 
spelling task—sounds 
Brigman, G., Lane, D., Switzer, D., Cluster ReadytoLearn Business as 145 students L S Metropolitan 0.07 
Lane, D., & Lawrence, R. (1999). RCT usual in 10 classrooms Readiness Test: 
Teaching children school success in 3 preschool Combined auditory 
skills. The Journal of Educational centers memory and school 
Research, 92(6), 323-329. language and listening 
http://doi.org/10.1080/0022067990 subtests 
9597615. Metropolitan 0.70 
Readiness Test: Story 
structure 
Cabell, S. Q., Justice, L. M., Piasta,S. Cluster Professional Business as 235 students L S PPVT-III 0.12 
B., Curenton, S. M., Wiggins, A., RCT development usual Wy 49 classrooms CELE Praschaol2: 0.03 
Turnbull, K. P., & Petscher, Y. (2011). on responsivity in 38 Head Start Expressive vocabulary 
The impact of teacher responsivity education centers and public 
**K 
education on preschoolers’ elementary PK s PWPA 0.40 
language and literacy skills. schools 


American Journal of Speech- 
Language Pathology, 20(4), 315- 
330. 
https://eric.ed.gov/?id=EJ946267. 


v80-T 207 144 


Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation ratelaals) group Analysis sample domain type Outcome measure measure correction 
Callcott, D., Hammond, L., & Hill, S. Cluster —Let’s Decode Business as 163 students PA S TOPA 0.48 
(2015). The synergistic effect of QED plus Moving on usual in 16 classrooms W S WRAT-Revised: 0.58 
teaching a combined explicit with Literacy in 8 primary Spelling 
movement and phonological schools 
ae. nara ina Let’s Decode Business as 146 students PA S TOPA 0.44 
SE om Phauenver any Se tee usual in 16 classrooms A 
Education Journal, 43(3), 201-211. in 8 primary ™ Dn Boveet: oe 
: : d= Spellin 
https://eric.ed.gov/?id=EJ1055702. schools pelling 
Callihan, K. D. (2003). Emergent RCT Storybook Storybook 4 students L RD Lexical richness 0.81 
literacy activities in preschool years: aie eet in 1 daycare Percentage of -1.03 
The effects of explicit instruction on ocusing on ocusing on center completed cohesive 
rhyming and narrative development narrative rhyme tieé-uead 
(UMI No. 1418524) [Master’s thesis, 
Marshall University]. ProQuest 
Dissertations & Theses database. 
Cesar, R. (2013). Read alouds in the RCT Read aloud Read Aloud 30 students L S Kaufman Survey of -0.53 
preschool classroom: A tool for program with program in 1 preschool Early Academic and 
developing pre-emergent fiction and with fiction Language Skills 
vocabulary, print awareness, and nonfiction books PA S PALS-Prek ~0.05 
comprehension skills (UMI No. books 
3578578) [Doctoral dissertation, 
University of Phoenix]. ProQuest 
Dissertations & Theses database. 
Christie, J., Roskos, K., Vukelich, C., Cluster Doors to Business as 53 students L S PPVT 0.45 
& Han, M. (2003). The effects of a QED Discovery usual in 5 classrooms 


well-designed literacy program on 
young children’s language and 
literacy development. In F. Lamb- 
Parker, J. Hagan, R. Robinson, & H. 
Rhee (Eds.), The first eight years, 
Pathways to the future: Implications 
for research, policy, and practice, 
Head Start’s Sixth National Research 
Conference (pp. 453-454). Columbia 
University, Mailman School of Public 
Health. 


https://eric.ed.gov/?id=ED474955. 


in 5 preschools 


v80-T 207 144 


NEL R Me) i Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Ciancio, D. J. (2004). Early RCT Enriched Storybook 106 students PA RD Rhyme matching 1.71 ee 
intervention: Effects of behavioral literacy reading in 7 Head Start Rhyme detection 1.19 ek 
regulation on learning and emerging intervention classrooms 
self-competence (UMI No. 3116629) PK RD Letter name 1.20 7 
[Doctoral dissertation, University of knowledge 
Notre Dame]. ProQuest Letter sound ~0.45 * 
Dissertations & Theses database. knowledge 
Clouser, K. F. (2001). The effects of QED Music therapy Music 50 students L S PPVT-Revised 0.22 
setting storybooks’ texts to music on activities with therapy in 4 preschools 
story comprehension, vocabulary, singing of activities 
and attitude towards reading in books with reading 
preschool children [Unpublished of books 
master’s thesis, Florida State 
University]. 
Davidson, M. R., Fields, M. K., & Cluster Ready, Set, Business as 254 students L S PPVT-III 0.01 
Yang, J. (2009). A randomized trial RCT Leap! usual in 17 public PA S CTOPP: Blending 0.18 
study of a preschool literacy elementary 
curriculum: The importance of schools DIBELS: Initial sound 0.16 
implementation. Journal of Research fluency 
on Educational Effectiveness, 2(3), WI-IIl: Rhyming 0.09 
177-208. : 
https://eric.ed.gov/?id=EJ866975. i 5 DIBEDS  bethar Nelininie “0:06 
fluency 
D S WJ: Letter-word 0.10 
identification 
Desmond, S. K. (2008). The effects of | RCT Rhyme training Math About 60 students PA S PIPA: Sound 0.28 
rhyme on phonological sensitivities manipulativ in 5 public segmentation 
(UMI No. 3326012) [Doctoral e preschool PIPA: Sauind ieolations 0.22 
dissertation, Seattle Pacific Intervention classrooms 
University]. ProQuest Dissertations PIPA: Alliteration 0.13 
& Theses database. awareness 
PIPA: Rhyme 0.45 
awareness 


NEL R Me) Effect Significant 


Intervention (oolnay ex-lasxela) Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Esler, A. N. (2001). Children at the Cluster Enhancing Business as 46 students L S Test of Early Language 0.75 
venter: Promoting child RCT language and usual in 7 classrooms Development-3 
development through evidence- social skills in 6 childcare 
based practice (UMI No. 9997644) using evidence- centers 
[Master’s thesis, University of based practices 


Minnesota]. ProQuest Dissertations 
& Theses database. 


Fischel, J. E., Bracken, S. S., Fuchs- Cluster Let’s Begin with Business as 335 students L S PPVT-III 0.20 
Eisenberg, A., Spira, E. G., Katz, S.,& RCT the Letter usual in 23 Head Start D S Wi-Ravised: letter 0.30 
Shaller, G. (2007). Evaluation of People classrooms word idantihicstion 
curricular approaches to enhance 
preschool early literacy skills. 228 students WwW S WJ-Revised: Dictation 0.37 
Journal of Literacy Research, 39(4), in 23 Head Start 
471-501. classrooms 
http://doi.org/10.1080/1086296070 Waterford Businessas 322 students L S PPVT-III 0.06 
1675333. i i 
26/5555. Early Reading usual : 23 Head Start D S WicRaviced: letter 0.12 
ieseroee word Identification 
277 students WwW S WJ-Revised: Dictation 0.04 


in 23 Head Start 
classrooms 


NEL R Me) Effect Significant 


Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Fricke, S., Bowyer-Crane, C., Haley, RCT Nuffield Early Business as 166 students L RD Listening 0.27 
A. J., Hulme, C., & Snowling, M. J. Language usual in 15 nursery comprehension 
(2013). Efficacy es shai sta a schools Narrative mean length 0.24 
intervention i the early years. 30 wee utterances 
Journal of Child Psychology and 
Psychiatry, 54(3), 280-290. Narrative number of 0.48 ia 
https://eric.ed.gov/?id=EJ1012716. words 
Narrative number of 0.41 oe 
different words 
S CELF Preschool-2 0.44 bee 
Expressive vocabulary 
CELF Preschool-2 0.13 
Sentence structure 
APT: Information 0.44 ae 
APT: Grammar 0.88 ane 
PA RD Alliteration matching 0.51 ja 
S YARC: Sound isolation 0.16 
PK RD Letter sounds 0.31 . 
D S YARC: Early word 0.16 
reading 


Ww RD Spelling 0.22 


(@lie-halola) 


Fricke, S., Burgoyne, K., Bowyer- 
Crane, C., Kyriacou, M., Zosimidou, 
A., Maxwell, L., Lervag, A., Snowling, 
M. J., & Hulme, C. (2017). The 
efficacy of early language 
intervention in mainstream school 
settings: A randomized controlled 
trial. Journal of Child Psychology and 
Psychiatry, 58(10), 1141-1151. 


https://eric.ed.gov/?id=EJ1154623. 


RCT 


Nature of Effect Significant 
Intervention (oolnay ex-lasxelal Outcome Outcome size for after B-H 
name group Analysis sample roloyaar-lia) type Outcome measure measure correction 
Nuffield Early Business as 234 students L RD Listening 0.26 
Language usual in 34 nursery comprehension 
sta a schools 5 _CELF Preschool-2: 0.23 
30 wee Expressive vocabulary 
CELF Preschool-2: 0.02 
Sentence structure 
BPVS 0.19 
APT: Information 0.05 
APT: Grammar 0.19 
PK S YARC: Letter-sound 0.19 
knowledge 
D S YARC: Early word —0.03 
reading 
Nuffield Early Business as 242 students L RD Listening 0.10 
Language usual in 30 nursery comprehension 
sh schools S CELF: Expressive 0.21 
20 wee vocabulary 
CELF: Sentence 0.20 
structure 
BPVS 0.09 
APT: Information 0.23 
APT: Grammar 0.21 
PK S YARC: Letter-sound —0.07 
knowledge 
D S YARC: Early word 0.15 


reading 


v80-T 207 144 


Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 


Citation name fAgeleye) domain type Outcome measure measure correction 


Analysis sample 


TT-4 


Gillis, M. B. (1998). Evidence for the RCT Print Print 37 students PA RD Rubin’s test of 0.55 
language basis of reading awareness awareness in 1 public rhyming awareness 
disabilities in preschool children curriculum plus — curriculum preschool S Tat af Awarehiessat 0.61 
(UMI No. 9907066) [Doctoral phonological Language Segments 
dissertation, University of awareness 
Louisville]. ProQuest Dissertations & intervention PK RD Clay's (1975) Stones: 0.29 
Theses database. The Concepts About 
Print Test 

Goldstein, H., Kelley, E.,Greenwood, Cluster Story Friends Story 154 students L S CELF Preschool 0.12 
C., McCune, L., Carta, J., Atwater, J... RCT with embedded — Friends in 32 public school PPVT-IV 0.17 
Guerrero, G., McCarthy, T., lessons without prekindergarten 
Schneider, N., & Spencer, T. (2016). embedded classrooms 
Embedded instruction improves lessons 
vocabulary learning during 
automated storybook reading 
among high-risk preschoolers. 
Journal of Speech, Language, and 
Hearing Research, 59(3), 484-500. 
https://eric.ed.gov/?id=ED577031. 
Goldstein, H., Olszewski, A., Haring, Cluster PAthto Story 104 students L S CELF Preschool-2 —0.20 
C., Greenwood, C. R., McCune, L., RCT Literacy Friends in 39 public PA S DIBELS: First sound 1.13 ae 
Carta, J., Atwater, J., Guerrero, G., prekindergarten fluency 
Schneider, N., McCarthy, T., & classrooms and 
Kelley, E. S. (2017). Efficacy of a childcare centers IGDI: First sounds 0.05 
supplemental phonemic awareness in 3 states TOPEL: Phonological -0.04 
curriculum to instruct preschoolers awareness 
with delays in early literacy PK 5 IGDI: Sound 0.23 
development. Journal of Speech, : Spe ae 

; identification 
Language, and Hearing Research, 
60(1), 89-103. TOPEL: Print 0.02 
https://eric.ed.gov/?id=ED577032. knowledge 
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cT-4 


Citation 


Intervention 
name 


Nature of 
comparison 
igeley) 


Outcome Outcome 


Analysis sample 


domain 


type 


Effect 
size for 
Outcome measure 


measure 


Significant 
after B-H 
correction 


Gong, Z., & Levy, B. A. (2009). Four eBook eBook 48 students PK RD WRAT-3: Letter 0.37 
year old children’s acquisition of reading— reading in 12 public naming items of the 
print knowledge during electronic Action schools reading subtest 
storybook reading. Reading and eBook eBook 48 students PK RD ~~ WRAT-3 Letternaming _—0.24 
Niele! rae ee reading— reading in 12 public items of the reading 
itps://eric.ed.gov/ fid=E1855305. Bouncing ball schools subtest 
eBook eBook 48 students PK RD WRAT-3 Letter naming 0.07 
reading— reading in 12 public items of the reading 
Violation schools subtest 
Guidry, L. O. (2003). A phonological RCT Whole-class Whole-class 48 students PA S Test of Awareness of —0.07 
awareness intervention for at -risk phonological phonological in 4 classrooms Language Segments 
preschoolers: Tne effects of awareness awareness in 1 public school DIBELS: Initial sound 0.21 
supplemental, intensive, small-group training with training only fluency 
instruction (UMI No. 3098070) supplemental 
[Doctoral dissertation, Louisiana small-group 
State University and Agricultural and instruction 
Mechanical College]. ProQuest 
Dissertations & Theses database. 
Haley, A., Hulme, C., Bowyer-Crane, RCT Oral language Business as 100 students L S CELF Preschool-2: -0.11 
C., Snowling, M. J., & Fricke, S. intervention usual in 13 nursery Expressive vocabulary 
(2017). Oral language skills (L4R) schools CELF Preschool-2: -0.01 
intervention in pre-school—a Gantande staiceeuce 
cautionary tale. International - 
Journal of Language & APT: Information 0.17 
Communication Disorders, 52(1), APT: Grammar 0.03 
lees YARC: Listeni 0.36 
http://doi.org/10.1111/1460- - ee 
6984.12257, comprehension 
PA RD Alliteration matching 0.07 
PK S YARC: Letter-sound 0.05 
knowledge 
D S YARC: Early word 0.28 
reading 
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€T-d 


Nature of Effect Significant 
Study Intervention comparison Outcome Outcome size for after B-H 
Citation design name group Analysis sample domain type Outcome measure measure correction 
Harris, S. (2010). Early intervention RCT Jumpstart Business as 66 students L S TERA: Meaning ne* = 
for poverty-stricken children: A study usual in3 preschools IGDI: Picture naming net * 
of preschoolers receiving Jumpstart and childcare 
. ] j + 
(UMI No. 3528245) [Doctoral programs PA s IGDI: Alliteration ne 
dissertation, Illinois State IGDI: Rhyming ne* 
University]. ProQuest Dissertations P _ ee 
@ Thesow databace, PK S TERA: Alphabet ne 
TERA: Conventions ne* -* 
G S Bracken School ne* ci 
Readiness Assessment 
Hong, S. Y., & Diamond, K. E. (2012). Cluster Responsive Responsive 72 students L RD Concepts and 1.01 ed 
Two approaches to teaching young QED teaching and teaching in 18 classrooms vocabulary 
children science concepts, explicit 
vocabulary, and scientific problem- instruction 
solving skills. Early Childhood 
Research Quarterly, 27(2), 295-305. 
https://eric.ed.gov/?id=EJ958051. 
Justice, L. M. (2000). An RCT Print-focused Picture- 30 students PK RD Print concepts 0.33 
experimental evaluation ofan storybook focused in 4 classrooms Print recognition 1.57 eee 
intervention to stimulate written reading storybook in 1 Head Start 
. . OK 
language awareness in preschool reading center Words in print 1.30 
children from low-income Letter orientation and 0.26 
households (UMI No. 9980417) discrimination 
[Doctoral dissertation, Ohio 
University]. ProQuest Dissertations Alphabet knowledge 0.48 
and Theses database. Literacy terms 0.47 
Justice, L. M., Chow, S. M., Capellini, © RCT Explicit Shared 18 students PA S PAT: Phonological ne* 
C., Flanigan, K., & Colton, S. (2003). emergent storybook in 1 preschool segmentation 
Emergent literacy intervention for literacy reading + center PAT: Rhyme net 
Patiala iets American intervention a production items from 
Journal of Speech-Language retelling rhyming subtest 
Pathology, (12)3, 320-332. 
http://doi.org/10.1044/1058- PK RD Alphabet knowledge ne* 
0360(2003/078). PWPA: Print concepts ne* 
W S PALS-PreK: Name ne* 


writing 


v80-T 207 144 


vi-d 


Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Justice, L.M., McGinty, A. S., Piasta, Cluster = Print-focused Print- 278 students L S CELF Preschool-2 0.08 
S.B., Kaderavek, J. N., & Fan, X. RCT storybook read focused in 58 classrooms G RD Standardized factor 0.23 
nee ee read-alouds in cach ae score frori: PAUS-Prak: 
preschoo classrooms: Intervention igh- ose print read alou Upper-case alphabet 
effectiveness and moderators of referencing recognition, PALS- 
child outcomes. Language, Speech, PreK: Name writing, 
and Hearing Services in Schools, and PWPA 
41(4), 504-520. 
https://eric.ed.gov/?id=EJ909127. 
Kelley, E. S., Goldstein, H., Spencer, RCT Story Friends Business as 18 students in L RD Assessment of story 0.72 
T. D., & Sherman, A. (2015). Effects usual 3 prekindergarten comprehension 
of automated Tier 2 storybook classrooms S PPVT-IV 0.21 
intervention on vocabulary and in 3 public 
comprehension learning in elementary CELF Preschool: Ore 0.22 
preschool children with limited oral schools language composite 
language skills. Early Childhood 
Research Quarterly, 31(1), 47-61. 
https://eric.ed.gov/?id=ED577028. 
Kelley, E. S., & Kinney, K. (2017). RCT Digital Digital 30 students L RD Definitional word 0.15 
Word learning and story storybook with — storybook in 2 preschool knowledge 
comprehension from digital : serail without centers Bacontextual word 0.21 
storybooks: Does interaction ma ea eatures interactive knowledge 
difference? Journal of Educational features : 
Computing Research, 55(3), 410- Receptive word 0.01 
428. knowledge 
https://eric.ed.gov/?id=EJ1141523. 
Lane, C., Prokop, M. J. S., Johnson, Cluster Building Blocks Business as 133 students G S GRTR 1.05 * 
E., B., Podhajski, & Nathan, J. (2014). QED for Literacy usual in 18 Head Start 
Promoting early literacy through the with distance classes 


professional development of 
preschool teachers. Early Years, 
34(1), 67-80. 
https://eric.ed.gov/?id=EJ1024475. 


mentoring 


v80-T20Z 144 


ST-4 


NEL R me) Effect Significant 
Intervention comparison (O]U} xeXo}aat= um @lU] Kore) a a=) size for after B-H 
Citation ratelaals) group Analysis sample domain type Outcome measure measure correction 
Langan, R. (2010). Reducing the RCT Storybook Storybook 26 students L RD Comprehension 1.99 ia? 
synonym effect: The impact of reading with reading with _ in several synonyms 
eee engagement SS s ostensive ostensive preschools Comprehension 0.43 
word learning during boo. reading questions and comments nonsynonyms 
(UMI No. 1483531) [Master’s thesis, feedback — 
Villanova University]. ProQuest Definition synonyms 0.72 
Dissertations and Theses database. Definition 0.96 * 
nonsynonyms 
Storybook Storybook 26 students L RD Comprehension 0.69 
reading with reading with in several synonyms 
scaffolded 5 ostensive preschools Comprehension 0.41 
questions an comments nonsynonyms 
feedback 
Definition synonyms 0.40 
Definition 0.85 
nonsynonyms 
Lee, W., & Pring, T. (2016). Cluster Talk Boost Business as 54 students iE S APT: Information 0.97 ee 
Supporting language in schools: RCT usual in 18 schools APT: Grammar 0.16 
Evaluating an intervention for 
children with delayed language in The Bus Story 0.46 


the early school years. Child 
Language Teaching and Therapy, 
32(2), 135-146. 
https://eric.ed.gov/?id=EJ1103212. 


Leung, C. B. (2008). Preschoolers’ RCT Storybook Storybook 32 students L RD Free recall target 0.39 
acquisition of scientific vocabulary reading + reading in 1 YWCA child word test 

through repeated read-aloud retelling development 

events, retellings, and hands-on center 


science activities. Reading 
Psychology, 29(2), 165-193. 


https://eric.ed.gov/?id=EJ790593. 
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91-4 


Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation rarelaal group Analysis sample domain type Outcome measure measure correction 
Lima, O. K. A. (2008). Proximal Cluster Storybook Storybook 106 students L RD Receptive target word ne 
processes in preschoolers’ word RCT reading with reading in 26 classrooms in Receptive incidental Rau 
learning from classroom storybook elaboration private preschools - 
sessions: Effects of teacher Receptive control ne" 
elaboration and child attention (UMI Expressive target ne" 
No. 3362854) [Doctoral dissertation, Banana ‘ 
University of Virginia]. ProQuest ddaeedlinRab tee ne 
Dissertations and Theses database Expressive control ne" 
Lonigan, C. J., Anthony, J. L., RCT Dialogic Storybook 54 students L S PPVT-Revised 0.39 
Bloomfield, B. G., Dyer, S. M., & reading reading in 5 childcare EOWPVT-Revised 0.02 
Samwel, C. S. (1999). Effects of two centers = 
shared-reading interventions on Illinois Test of 0.17 
emergent literacy skills of at-risk Psycholinguistic 
preschoolers. Journal of Early Abilities: Verbal 
Intervention, 22(4), 306-322. expression 
http://doi.org/10.1177/1053815199 W5: Listening 0.13 
02200406. comprehension 
Lonigan, C.J., Driscoll, K., Phillips, B. ©§ RCT Computer- Business as 41 students PA RD Rhyme oddity 0.77 . 
M., Cantor, B. G., Anthony, J. L., & assisted usual in 1 Head Start Rhyme matching 0.79 
Goldstein, H. (2003). A computer- instruction center - 
assisted instruction phonological Word blending 0.33 
sensitivity program for preschool Syllable/phoneme 0.01 
children at-risk for reading blending 
problems. Journal of Early , , 
Intervention, 25(4), 248-262. i ee Osb 
https://eric.ed.gov/?id=EJ674627. ee 
Word elision 0.75 . 
Syllable/phoneme 0.95 es 
elision 
Multiple-choice elision 0.31 


NEL Re) Effect Significant 


Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Lonigan, C. J., Farver, J. M., Phillips, Cluster Literacy Business as About L S Preschool Language 0.32 
B. M., & Clancy-Menchetti, J. (2011). RCT Express usual 508 students Scale-lV 
Promoting the development of Preschool in 33 Head Start PA S Preschool CTOPP: 0.34 
preschool children’s emergent Curriculum plus centers and Title | Elision 
literacy skills: A randomized workshop and schools 
evaluation of a literacy-focused in-class Preschool CTOPP: 0.11 
curriculum and two professional mentoring Blending 
development models. Reading and PK S Preschool CTOPP: 0.44 * 
Writing, 24(3), 305-337. Print knowledge 


https://eric.ed.gov/?id=EJ915825. 


Effect 
size for 


Significant 
after B-H 


Nature of 


Intervention comparison Outcome Outcome 
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Lonigan, C. J., Phillips, B. M., Clancy, 
J. L., Landry, S. H., Swank, P. R., 
Assel, M., Taylor, H. B., Klein, A., 
Starkey, P., Domitrovich, C. E., 
Eisenberg, N., Villiers, J., Villiers, P., 
& Barnes, M. (2015). Impacts of a 
comprehensive school readiness 
curriculum for preschool children at 
risk for educational difficulties. Child 
Development, 86(6), 1773-1793. 
https://eric.ed.gov/?id=EJ1079878. 


Cluster 
RCT 


name group Analysis sample roloyaar-lia) type Outcome measure measure correction 
Literacy Business as About L S DELV: Language -0.07 
Express usual 445 students Variation Status 
Preschool in 60 preschool screener A 
Curriculum + centers DELV: Language 0.21 
Pte , Variation Status 
Mathematics seraanoril 
Curriculum + 
PATHS Explicit EOWPVT 0.15 
DELV: Diagnostic Risk 0.14 
Status screener 
PA S TOPEL: Elision 0.26 
TOPEL: Blending 0.26 
PK S TOPEL: Print 0.19 
knowledge 
Literacy Business as About L S DELV: Language -0.05 
Express usual 445 students Variation Status 
Preschool in 60 preschool screener A 
Curriculum + centers DELV: Language 0.19 
has : Variation Status 
Mer ematics ecesenere 
Curriculum + 
PATHS Implicit EOWPVT 0.11 
DELV: Diagnostic Risk 0.24 
Status screener 
PA S TOPEL: Elision 0.21 
TOPEL: Blending 0.31 
PK S TOPEL: Print 0.16 


knowledge 


NEL Re) Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Lonigan, C. J., & Phillips, B. M. RCT Tier 2: Business as 60 students L RD CLIP: Language 0.06 
uae nia ee in ee and usual in12 ee | S Preschool CTOPP: 0.25 
se 00 Lees fe) be i code- ocused preschools Definitional 
ran fomnize stu ies wit chi dren at intervention vocabulary 
significant risk of reading difficulties. for children 
Journal of Educational Psychology, who qualified Preschool CTOPP: —0.26 
108(1), 114-129. for language- Receptive vocabulary 
https://eric.ed.gov/?id=EJ1086979. focused or CELF Preschool: 0.29 
code- and Receptive language 
language- 
ele CELF Preschool: 0.27 
focused E ive | 
chenantion xpressive language 
(study 1) 
Tier 2: Code- Business as 81 students PA S Preschool CTOPP: 0.15 
and language- usual in 12 Title | Elision 
focused . preschools Preschool CTOPP: -0.25 
intervention Blending 
for children 
who qualified PK RD CLIP: Letter names 0.25 
for code- CLIP: Letter sounds 0.19 
focused or 
S Preschool CTOPP: 0.10 
code- and : 
Print knowledge 
language- 
focused G S TERA —0.06 


intervention 
(study 1) 


NEL R Me) Effect Significant 


Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 

Tier 2: Business as 132 students L S Preschool CTOPP: —0.04 
Intensive usual in 21 Title | Definitional 
language- and prekindergarten vocabulary 
code-facused RIDE Sie Preschool CTOPP: 0.21 
inneere won Receptive vocabulary 
for children 
who qualified CELF Preschool: 0.07 
for language- Receptive language 
focused or CELF Preschool: 0.00 
code- and Expressive language 
language- 
focused 
intervention 
(study 2) 
Tier 2: Business as 148 students PA S Preschool: CTOPP: 0.45 oe 
Intensive code- _—_— usual in 21 Title | Elision 
ae ete, prekindergarten Preschool CTOPP: 0.13 
focuse programs Blending 
intervention 
for children PK RD CLIP: Letter names 0.14 
who qualified CLIP: Letter sounds 0.18 
for code- 

S Pre-CTOPP: Print 0.20 
focused or 

knowledge 

language- and 
code-focused G S TERA-3 -—0.10 


intervention 
(study 2) 
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Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation rarelaals group Analysis sample domain type Outcome measure measure correction 
Lonigan, C.J., Purpura, D.J., Wilson, © RCT Dialogic Business as 129 students L RD Language composite 0.34 
S.B., Walker, P.M., & Clancy- reading and usual in 13 Head Start PA RD Phonological 0.31 
Menchetti, J. (2013). Evaluating the phonological centers and Title | awareness composite 
components of an emergent literacy awareness preschools 
intervention for preschool children intervention PK RD Print knowledge 0.00 
at risk for reading difficulties. composite 
Journal of Experimental Child Dialogic Businessas 139 students L RD Language composite 0.13 
Psychology, 114(1), 111-130. i i ; 
4 7 e fe a ee reading, usual in 13 Head Start PA RD PHOnOlOaical 0.32 
https://eric.ed.gov/?id=EJ1006636. phonological centers and Title | awareness composite 
awareness, and preschool 
letter PK RD Print knowledge 0.19 
knowledge composite 
Storybook Business as 136 students L RD Language composite 0.00 
oe i usual in 13 ee PA RD Phonological 0.29 
phonologica centers and Title | awareness composite 
awareness, and preschools 
letter PK RD Print knowledge 0.03 
knowledge composite 
Dialogic Business as 136 students L RD Language composite 0.20 
Reading and usual in 13 Head re PA RD Phonological 0.13 
letter centers and Title | awareness composite 
knowledge preschools 
PK RD Print knowledge 0.14 
composite 
Macaruso, P., & Rodman, A. (2011). Cluster Computer- Business as 38 students PA S Group Reading 0.84 
Efficacy of computer-assisted RCT assisted usual in 8 classrooms Assessment and 
instruction for the development of instruction— Diagnostic Evaluation 
early literacy skills in young children. Early Reading 
Reading Psychology, 32(2), 172-196. 
https://eric.ed.gov/?id=EJ920179. 
Majsterek, D.J., Shorr, D. N., & Cluster Phonological Semantic 40 students in PA RD Rhyme detection task 0.57 
Erion, V. L. (2000). Promoting early RCT awareness training 1 Head Start 
literacy through rhyme detection training center 


activities during Head Start circle- 
time. Child Study Journal, 30(3), 
143-143. 
https://eric.ed.gov/?id=EJ626919. 
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Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Mannes, T. J. (2013). The effect of Cluster Kindergarten Business as 94 students D RD Sight words ne* 
tier one literacy practices on QED Peer Assisted usual in 6 classrooms 
preschoolers emergent literacy skills Literacy 
(UMI No. 3591959) [Doctoral Strategies and 
dissertation, Michigan State Developing 
University]. ProQuest Dissertations Talkers 
and Theses database. 
Massetti, G. M. (2009). Enhancing Cluster Stony Brook Business as 116 students PK RD GRTR-Revised: Print 1.75 a 
emergent literacy skills of RCT Emergent usual in 10 Head Start awareness 
preschoolers from low-income Literacy Project classrooms S Developing Skills 1.89 *eK 
environments through a classroom- Checklist Pant 
based approach. School Psychology “qvaraness 
Review, 38(4), 554-569. 
https://eric.ed.gov/?id=EJ867982. 
Mincic, M. S. (2009). Dialogic Cluster —_ Dialogic Storybook 114 students L S TOPEL: Vocabulary ne* 
reading with emotion-laden RCT reading with reading in 15 Head Start 
storybooks: Intervention methods to emotion-laden classrooms 
enhance children’s emergent literacy storybooks 
and social-emotional skills (UMI No. 
3364575) [Doctoral dissertation, 
George Mason University]. ProQuest 
Dissertations and Theses database. 
Nelson, J. R., Sanders, E. A., & RCT Stepping Interactive 88 students L S TOPEL: Definitional 0.12 
Gonzalez, J. (2009). The efficacy of Stones to book in 8 Head Start vocabulary 
supplemental early literacy Literacy reading classrooms PA S TOPEL: Phonological 0.20 
instruction by community-based aahAWOss 
tutors for preschoolers enrolled in 
Head Start. Journal of Research on PK RD TOPEL Section A: Print —0.34 
Educational Effectiveness, 3(1), 1- knowledge 
25. TOPEL Sections B and 0.37 


https://eric.ed.gov/?id=EJ877224. 


C: Print knowledge 
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Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Neuman, S. B. (2017). The Cluster — Library with Business as 346 students L RD Concepts of 0.01 
information book flood: Is additional © RCT additional usual in 10 schools comprehension 
exposure enough to support early supports S PP\T 0.29 
literacy development? The 
Elementary School Journal, 118(1), EOWPVT 0.22 
1-27. 
https://eric.ed.gov/?id=EJ1162722. 
Neuman, S. B., Pinkham, A., & Cluster Educative Business as 143 students in 10 L RD Comprehension 0.69 oe 
Kaefer, T. (2015). Supporting RCT curriculum usual prekindergarten assessment 
vocabulary teaching and learning in material classrooms S PPVT-IV 0.04 
prekindergarten: The role of supports in 5 elementary 
educative curriculum materials. schools 
Early Education and Development, 
26(7), 988-1011. 
https://eric.ed.gov/?id=EJ1070888. 
Neumann, M. M., Hood, M., & Ford, RCT Environmental Standard 48 students PK RD Letter name 0.21 
R. M. (2013). Using environmental print print in 4 preschools knowledge 
print to enhance emergent literacy ieversaund 0.42 
and print motivation. Reading and knowledge 
Writing, 26(5), 771-793. 
https://eric.ed.gov/?id=EJ1000168. Print concepts 0.25 
WwW RD Letter writing —0.09 
O'Leary, R. (2017). Do spellings of RCT Phoneme Phoneme 40 students Ww RD Invented spelling 0.42 
words and phonemic awareness segmentation segmentation in public, private, 
training facilitate vocabulary training using training using and charter 
learning in preschoolers? (Order No. letters to spell shapes to schools 
10275850) [Doctoral dissertation, spell 


The City University of New York]. 
ProQuest Dissertations and Theses 
database. 
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Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Palmiter, A. B. W. (2013). The effects RCT Storybook Storybook 84 students L RD Receptive target word —0.34 
of adult scaffolding and child reading with reading with — in Head Start Expressive target ~0.15 
executive functioning skills on full scaffolded ostensive classrooms ward 
vocabulary learning during shared questions and repetition — 
book reading (UMI No. 3585307) comments Definition target word — —0.06 
[Doctoral dissertation, University of 
Notre Dame]. ProQuest 
Dissertations and Theses database. 
Patchan, M. M., & Puranik, C. S. Cluster Writing using Writing 30 students PK RD Letter naming 0.44 
(2016). Using tablet computers to RCT iPad and stylus —_ using paper in 10 classrooms W RD Letter writing 0.27 
teach preschool children to write and pencil in 6 preschools 
ah ele pee : Writing using Writing 30 students PK RD Letter naming 0.02 
extrinsic and intrinsic feedback. , 2 ae . 
iPad and finger using iPad in 10 classrooms a * 
j WwW RD Letter writin 0.97 
Computers & Education, 102(1), and stylus in 6 preschools g 
128-137. 
http://doi.org/10.1016/j.compedu.2 
016.07.007. 
Penuel, W. R., Bates, L., Gallagher, L. Cluster Professional Professional 396 students PA S PALS-PreK: Beginning ne* 
P., Pasnik, S., Llorente, C., RCT development development in 80 classrooms sound awareness 
Townsend, E., Hupert, N., : baste media-rich ihe media- in 2 states PK S PALS-PrekK: Letter net eK 
Dominguez, X., & VanderBorg t, M. iteracy rich Science name knowledge 
(2012). Supplementing literacy supplement supplement 
. + KKK 
instruction with a media-rich PALS-PreK: Letter ne 
intervention: Results of a sounds 
randomized controlled trial. Early 
Childhood Research Quarterly, 27(1), 
115-127. 
https://eric.ed.gov/?id=EJ947504. 
Phillips, B. M., Tabulda, G., Ingrole, RCT Literate Business as 77 students L S CELF Preschool-2: 0.08 
S. A., Burris, P. W., Sedgwick, T. K., & language usual in 7 public Title | Sentence structure 
Chen, Ss. (2016). ve language intervention prekindergarten Oesland written 0.31 
intervention wit ig -need programs Language Scales: 
prekindergarten children: A ; Listening 
randomized trial. Journal of Speech, comprehension 
Language, and Hearing Research, 
59(6), 1409-1420. W4J-lIIl: Picture -0.14 
https://eric.ed.gov/?id=EJ1124170. vocabulary 


NEL R Me) Effect Significant 


Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Piasta, S. B. (2008). Developing RCT Letter name Business as 38 students PA S TOPEL: Phonological 0.31 
emergent literacy skills: The impact letter sounds usual in 4 private awareness 
ee (UMI No. intervention childcare centers PK RD Latter name 0.21 
( I octora Neser anon production 
Florida State University]. ProQuest 
Dissertations and Theses database. Letter name 0.13 
recognition 
Letter sound 0.46 
production 
Letter sound 0.30 
recognition 
D S WJ: Letter-word 0.05 
identification 
Letter sounds Business as 38 students PA S TOPEL: Phonological 0.02 
only usual in 4 private awareness 
intervention childcare centers PK RD latter pane 0.23 
production 
Letter name —0.23 
recognition 
Letter sound 0.11 
production 
Letter sound 0.03 
recognition 
D S WJ-IIl: Letter-word 0.03 
identification 
Pietrangelo, D. J. (1999). Outcomes Cluster Phonological Business as 129 students L S PPVT-III 0.16 
of an enhanced literacy curriculum RCT awa reness usual in 10 Head Start PA RD Alliteration 0.38 
on the emergent literacy skills of training plus classrooms : 
Head Start preschoolers (Doctoral letter Rhyming 0.38 
dissertation). Available from knowledge Phoneme blending 0.47 
ProQuest Dissertations and Theses training 


database. (UMI No. 9927614). me BO: nvented:spelling oP 


NEL R Me) Effect Significant 


Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Pollard-Durodola, S. D., Gonzalez, J. Cluster Words of Oral Business as 125 students L S PPVT-III 0.09 
E., Simmons, D.C., Kwok, O., Taylor, RCT Reading and usual in 6 public EOWPVT 0.08 
A. B., Davis, M. J., Kim, M., & Language preschool 
Simmons, L. (2011). The effects of Development classrooms and 
an intensive shared book-reading 12 Head Start 
intervention for preschool children classrooms 


at risk for vocabulary delay. 
Exceptional Children, 77(2), 161- 


183. 
https://eric.ed.gov/?id=EJ918889. 
Preschool Curriculum Evaluation Cluster Bright Business as About L S PPVT 0.17 
Research Consortium. (2008a). RCT Beginnings usual 197 students TOU: Granunatical 0.15 
Bright Beginnings and Creative curriculum in 14 preschool understanding 
Curriculum: Vanderbilt University. In classrooms 
Effects of Preschool Curriculum PA Ss Preschool CTOPP: —0.03 
Programs on School Readiness Elision 
(NCER No. 2008-2009). U.S. D S WJ: Letter-word 0.34 
Department of Education, Institute Identification 
of Education Sciences, National : 
Center for Education Research. bi 7 Wir spelling oP 
G S TERA 0.31 
Creative Business as 193 students L S TOLD: Grammatical 0.12 
Curriculum usual in 14 preschool understanding 
classrooms PPVT 0.28 
PA S Preschool CTOPP: 0.04 
Elision 
D S WJ: Letter-word 0.17 
identification 
S WS: Spelling 0.20 


G S TERA 0.00 
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Lc-4 


Citation 


Intervention 


name 


Nature of 
comparison 
group 


Analysis sample 


Outcome Outcome 


domain type 


Outcome measure 


Effect 
size for 


measure 


Preschool Curriculum Evaluation Cluster Creative Business as About L S TOLD: Grammatical 0.18 

Research Consortium. (2008b). RCT Curriculum usual 169 students understanding 

Creative Curriculum: University of in 18 preschool PPVT 0.04 

North Carolina at Charlotte. In classrooms 

Effects of Preschool Curriculum PA s Preschool CTOPP: 0.06 

Programs on School Readiness Elision 

(NCER No. 2008-2009). U.S. D S WJ: Letter-word -0.20 

Department of Education, Institute identification 

of Education Sciences, National - 

Center for Education Research. Ww W1: Spelling ne 
G S TERA —0.19 

Preschool Curriculum Evaluation Cluster Creative Business as 105 students PA S Preschool CTOPP: -0.1 

Research Consortium. (2008c). RCT Curriculum usual in 14 preschool Elision 

Creative Curriculum with Ladders to with Ladders to classrooms 

Literacy: University of New Literacy 

Hampshire. In Effects of Preschool 

Curriculum Programs on School 

Readiness (NCER No. 2008-2009). 

U.S. Department of Education, 

Institute of Education Sciences, 

National Center for Education 

Research. 

Preschool Curriculum Evaluation Cluster Curiosity Business as About L S PPVT -0.19 

Research Consortium. (2008q). RCT Corner usual 200 students TOLD: Grammatical 0.24 

Curiosity Corner: Success for All curriculum in 18 preschools understanding 

Foundation. In Effects of Preschool 

Curriculum Programs on School PA s Preschool CTOPP: —0.19 

Readiness (NCER No. 2008-2009) Elision 

(pp. 75-83). U.S. Department of D S WJ: Letter-word -0.18 

Education, Institute of Education identification 

Sciences, National Center for - 

Education Research. : Wiropelling =e? 
G S TERA -0.13 
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NEL R Me) Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Preschool Curriculum Evaluation Cluster Language- Business as About L S PPVT 0.01 
Research Consortium. (20088). RCT Focused usual 180 students TOLD =Grammatical 0.02 
Language-Focused Curriculum: Curriculum in 14 preschool understanding 
University of Virginia. In Effects of classrooms 
Preschool Curriculum Programs on PA s Preschool CTOPP: 0.20 
School Readiness (NCER No. 2008- Elision 
2009) (pp. 109-116). U.S. D S WJ: Letter-word 0.15 
Department of Education, Institute identification 
of Education Sciences, National : 
Center for Education Research. > Wirspelling res 
G S TERA 0.22 
Preschool Curriculum Evaluation Cluster DLM Early Business as About S PPVT 0.51 
Research Consortium. (2008h). RCT Childhood usual 190 students TOLD: Grammatical 0.40 
Literacy Express and DLM Early Express in 12 preschools understanding 
Childhood Express Supplemented supplemented 
with Open Court Reading Pre-K: with Open PA s Preschool CTOPP: 0.34 
Florida State University. In Effects of Court Reading Elision 
Preschool Curriculum Programs on Pre-K D S WJ: Letter-word 0.57 
School Readiness (NCER 2008-2009) identification 
(pp. 117-130). U.S. Department of : : 
Education, Institute of Education wv Wirspelling D2 
Sciences, National Center for G S TERA 0.69 
Education Research. Literacy Businessas About L S PPVT 0.36 
Sane : usual 183 be | TOLD: Grammatical 0.05 
BES? 00 in 12 preschools understanding 
Curriculum 
PA S Preschool CTOPP: 0.29 
Elision 
D S WJ: Letter-word 0.33 
identification 
S W3J: Spelling 0.17 
G S TERA 0.34 


Effect 
size for 


Significant 
after B-H 


Nature of 


comparison Outcome Outcome 


Intervention 


v80-T20Z 1440 
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Citation name group Analysis sample domain type Outcome measure measure correction 
Preschool Curriculum Evaluation Cluster Project Business as 192 students L S PPVT -0.25 
Research cote (2008i). RCT Approach usual in 12 preschools TOLD=Grammatical ~0.31 
Project Approac : Purdue - understanding 
University/University of Wisconsin. 
In Effects of Preschool Curriculum PA s Preschool CTOPP: —0.31 
Programs on School Readiness Elision 
(NCER No. 2008-2009) (pp. 143- D S WJ: Letter-word ~0.06 
151). U.S. Department of Education, identification 
Institute of Education Sciences, : 
National Center for Education WiPePeints ed 
Research. G S TERA 0.36 
Price-Mohr, R., & Price, C. (2017). Cluster Nonphonically Phonically 176 students IL S BPVS 0.04 
Gender differences in early reading QED decodable decodable in 16 schools 
strategies: A comparison of vocabulary vocabulary 
synthetic phonics only with a mixed with mixed with mixed 
approach to teaching reading to 4-5 teaching teaching 
year-old children. Early Childhood methods methods 
Education Journal, 45(5), 613-620. 
http://doi.org/10.1007/s10643-016- 
0813-y. 
RMC Research Corporation. (2003). Cluster Ready, Set, Business as 254 students L S PPVT-III 0.01 
! . | i 

tai Leap! aie Newark RCT Leap! usual in 17 preschools PA S Composite scores by 0.27 
pre - lergarten study 2002-2003 averaging raw scores 
final report. from DIBELS: Initial 

sound fluency, CTOPP: 

Blending words, and 

Woodcock-Johnson: 

Sound awareness— 

rhyming 

PK S DIBELS: Letter naming —0.08 
fluency 
D S WJ: Letter-word 0.12 


identification 


NEL Re) Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name f-ageleye) Analysis sample domain type Outcome measure measure correction 
Ruston, H. P., & Schwanenflugel, P. RCT Talking buddies Business as 74 students L S Expressive Vocabulary 0.35 
J. (2010). Effects of a conversation usual in 6 classrooms Test 
vine eee i nes in 4 preschool RD Lexical diversity from 0.21 
vocal ulary deve opment fe) centers language sample 
prekindergarten children. Language, 
Speech, and Hearing Services in 
Schools, 41(3), 303-313. 
https://eric.ed.gov/?id=EJ892596. 
Russell, J. (2005). An investigation of Cluster Ladders to Business as 34 students L RD Mean length of -0.13 
preschool oral language RCT Literacy + usual in 12 preschools utterance 
improvements through Ladders to Creative Type token ratio 0.05 
Literacy [Unpublished doctoral Curriculum 
dissertation, University of New 
Hampshire]. 
Sa, A. (2012). Fostering RCT Narrative Story 26 students L RD Story book 0.63 
preschoolers’ narrative Dynamics and Grammar/ in several comprehension book 
comprehension through inference story acting out preschool 1 
making and story reenactment reenactment classrooms Story book 0.56 
training (UMI No. 3542680) comprehension book 
[Doctoral dissertation, Lehigh 2 
University]. ProQuest Dissertations 
and Theses database. Retelling idea unit 0.28 
Retelling story 0.32 
grammar elements 
Retelling total 1.11 ial 
comprehension 
Narrative picture 1.70 The 
sequence total 
S CELF: Expressive 0.03 


vocabulary 
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Nature of Effect Significant 

Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Schwanenflugel, P. J., Hamilton, C. Cluster Universal Universal 163 students L S PPVT-III —0.07 
E., Neuharth-Pritchett, S., Restrepo, § RCT Quality Literacy Quality in 37 classrooms Expressive Vocabulary 0.11 
M.A., Bradley, B. A., & Webb, M. Y. Practices plus Literacy in 18 public Tact 
(2010). PAVEd for success: An PAVEd for Practices plus schools 
evaluation of a comprehensive Success PAVEd for PA RD Adapted PAT 0.12 
preliteracy program for four-year- program focus Success PK RD Alphabet knowledge: 0.08 
old children. Journal of Literacy on program Letter name 
Research, 42(3), 227-275. phonological (PAVE) focus 
https://eric.ed.gov/?id=EJ897192. awareness and on PIPMeBet knowiedzer — -O,0% 

a 2 Letter sounds 

explicit phonological 

vocabulary awareness 

enhancement only 

practices 
Scott, D. D. (2005). Investigating the Cluster Emergent Business as 92 students L S IGDI: Picture naming —0.02 
behavioral outcomes of an early RCT literacy usual in 6 Head Start 
literacy intervention for at-risk intervention classrooms 
preschool children (UMI No. 
3177496) [Doctoral dissertation, 
University of Virginia]. ProQuest 
Dissertations and Theses database. 
Smith, S. H. (1998). The effects of a Cluster Integrated Business as 114 students D S WJ-Revised: Letter- 1.25 ba 
whole language method of RCT Phonics usual in 8 classrooms word identification 
instruction and an integrated in 4 public WI-Revised: Word 0.38 
phonics method of instruction on the elementary attack 
reading achievement of inner-city schools 

W S WJ-Revised: Dictation 0.96 = 


preschool pupils (UMI No. 9826788) 
[Doctoral dissertation, The George 
Washington University]. ProQuest 
Dissertations and Theses database. 


Té-4 


NEL R ey Effect Significant 


Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Stockard, J. (2009). Promoting early —§ RCT Funnix Business as 37 students PA S DIBELS: Phoneme 2.18 psa 
literacy of preschool children: A Beginning usual in 6 Head Start segmentation fluency 
study of the effectiveness of Funnix Reading classrooms PK S DIBELS: Letter naming 0.55 
Beginning Reading (Technical computer fluency 
Report No. 2009-1). National program ; 
Institute of Direct Instruction. D RD 100 word list 0.52 
https://eric.ed.gov/?id=EJ908028. Controlled Text 0.46 

Passages 
S Woodcock Reading 0.99 ne 


Mastery Tests: Word 
identification 


Woodcock Reading 1.46 — 
Mastery Tests: Word 
attack 
DIBELS: Nonsense 0.70 
word fluency 
Talley, S., Lancy, D. F., & Lee, T. R. RCT CD-ROM (IBM’s _ Business as 61 students PK S PAT 0.17 
(1997). Children, storybooks and Stories and usual in 8 classrooms Concepts About Print ~0.09 
computers. Reading Horizons, 38(2), More) in 1 Head Start — 
116-128. Retrieved March 13, 2018, center Picnic test 0.03 
from 


https://scholarworks.wmich.edu/re 


ading_ horizons/vol38/iss2/7/. 


NEL R Me) Effect Significant 


Intervention comparison Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Thompson, P. S. (2015). Scaffolding RCT Interactive Business as 174 students L S CPAA: Listening —0.20 
emergent literacy skills in pre- reading and usual in 9 classrooms PA S CPAA: Phonemic 0.42 ee 
kindergarten through writing writing in 4 public schools awareness 
instruction (UMI No. 3702167) intervention 
[Doctoral dissertation, Middle PK s COs: Letter —0.04 
Tennessee State University]. recognition 
ProQuest Dissertations and Theses COS: Sound 0.38 * 
database. knowledge 
COS: Print knowledge 0.46 i 
D S CPAA: Phonics 0.22 
Ww S Test of Early Written 0.10 
Language 

G S CPAA: Reading 0.08 
Trotti, J., Hendricks, R., & Bledsoe, RCT Imagine Business as 102 students PA S CIRCLE: Phonological 0.13 
C. (2017). Emergent literacy Learning usual awareness 
development and computer assisted G S CIRCLE: Composite 0.26 
instruction. SRATE Journal, 26(1), 
30-39. Waterford Business as 111 students PA S CIRCLE: Phonological 0.14 
https://eric.ed.gov/?id=EJ1134394. Early Learning usual awareness 

G S CIRCLE: composite 0.30 
Tyler, A. A., Lewis, K. E., Haskill, A., & © RCT Morphosyntax Business as 17 students L RD Percent change in 0.65 
Tolbert, L. C. (2003). Outcomes of intervention usual in preschools morphosyntactic 
different speech and language goal performance 


attack strategies. Journal of Speech, 
Language, and Hearing Research, 
46(5), 1077-1094. 
https://eric.ed.gov/?id=EJ823316. 


Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 


Citation name group domain type Outcome measure measure correction 


Analysis sample 
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ves 


Walsh, B. (2009). Novel word RCT Storybook Storybook 29 students RD Seasonal word 0.11 
learning of preschoolers enrolled in reading with reading in 1 Head Start comprehension game 
ek Start Paar and ial see center Seasonal word 0.15 
classrooms: gens ofa ult voca ia ary production game 
vocabulary noneliciting questions questions 
during shared storybook oe Storybook Storybook 30 students RD Seasonal word —0.34 
(UMI a 3384573) [Doctora reading with reading in 1 Head Start comprehension game 
dissertation, Texas Woman’s eliciting eater 
University]. ProQuest Dissertations Seasonal word 0.46 
and Theses database nacelle production game 
. questions 
Walsh, B. A., & Blewitt, P. (2006). RCT Storybook Storybook 23 students RD New Word 3.38 See 
The effect of questioning style reading with reading in childcare Comprehension Test 
during storybook reading on novel eliciting centers or nursery New Word Praduction 0.59 
vocabulary acquisition of vocabulary schools Test 
preschoolers. Early Childhood questions 
Education Journal, eo 273-278. Storybook Storybook 24 students RD New Word 2.12 ae 
https://eric.ed.gov/?id=EJ747238. reading with reading in childcare Comprehension Test 
noneliciting centers or nursery New WardiPraduction 0.95 * 
vocabulary schools Test 
questions 
Washington, K. N., Warr-Leeper,G., = RCT My Sentence Non- 22 students S Structured 0.04 
& Thomas-Stonell, N. (2011). Builder computer- in government- Photographic 
Exploring the outcomes of a novel assisted funded speech Expressive Language 
computer-assisted treatment treatment and language Test—Preschool 
program iene eran programs Developmental 0.25 
grammar deficits in presc 00 ers sentence scoring 
with SLI. Journal of Communication 
Disorders, 44(3), 315-330. 
https://eric.ed.gov/?id=EJ925765. 
Wasik, B. A., & Bond, M. A. (2001). Cluster Interactive Repeated 121 students RD Receptive vocabulary 1.58 ph 
Beyond the pages of a book: RCT book reading reading in 4 classrooms Expressive vocabulary 2.05 4x 
interactive book reading and in 1 Title | early 
S PPVT-III ne* 


language development in preschool 
classrooms. Journal of Educational 
Psychology, 93(2), 243. 
https://eric.ed.gov/?id=EJ638739. 


learning center 
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Nature of Effect Significant 
Intervention comparison Outcome Outcome size for after B-H 
Citation name f-ageleye) Analysis sample domain type Outcome measure measure correction 
Wilcox, M.J., Gray, S. |., Guimond, Cluster Teaching Early Business as 118 students Ww S PALS-PreK: Name 0.26 
A. B., & Lafferty, A. E. (2011). RCT Literacy and usual in 29 classrooms writing 
Efficacy of the TELL language and Language 
literacy curriculum for preschoolers curriculum 


with developmental speech and/or 
language impairment. Early 
Childhood Research Quarterly, 26(3), 


278-294. 

https://eric.ed.gov/?id=EJ924085. 

Willoughby, D., Evans, M.A., & QED Paper alphabet Storybook 59 students PA S TOPA-Kindergarten: 0.15 

Nowak, S. (2015). Do ABC eBooks book reading reading in public and Initial sound-same 

boost engagement and learning in private schools subtest 

preschoolers? a experimental PK RD Letter-naming task 0.15 

study comparing eBooks with paper 

ABC and storybook controls. Letter-sound task —0.16 

Computers & Education, 82(1), 107— Electronic Storybook 62 students PA S TOPA-Kindergarten: 0.06 

117. alphabet book _ reading in public and Initial sound-same 

http://doi.org/10.1016/j.compedu.2 reading private schools subtest 

014.11.008. 

OL 11008 PK RD Letter-naming task —0.06 
Letter-sound task —0.26 

Witt, E. N. (2000). Effects of reading RCT Performance- Interactive 20 students L RD Story retelling 0.33 

styles on African-American oriented storybook in 2 Head Start World knowledge task 0.31 

preschoolers of disadvantage (UMI storybook reading classrooms 7 

No. 9998719) [Doctoral dissertation, reading in 1 school PK RD bo of acquisition of —0.60 

Louisiana State University and literacy concepts 


Agricultural and Mechanical 
College]. ProQuest Dissertations and 
Theses database. 


Wyant, A. B. (2008). What type of RCT Storybook Ostensive 37 students L RD Definition 0.14 
extra-textual input is optimal for reading with repetition in preschool Comprehension ~0.23 
preschoolers’ vocabulary learning eliciting classrooms 
during storybook reading? (UMI No. vocabulary 
1454132) [Master’s thesis, Villanova questions with 
University]. ProQuest Dissertations full scaffolded 
and Theses database. questions and 
comments 


NEL R Me) Effect Significant 


Intervention oolnay ex-lasxela) Outcome Outcome size for after B-H 
Citation name group Analysis sample domain type Outcome measure measure correction 
Yeh, S. S. (2003). An evaluation of Cluster Rhyming/alliter Segmenting 44 students PK RD Letter-sound 0.77 ie 
two approaches for teaching QED ation Intervention in 4 classrooms matching 
phonemic awareness to children in intervention in 2 Head Start D RD Oral reading 1.10 ane 
Head Start. Early Childhood centers 


Research Quarterly, 18(4), 513-529. 
https://eric.ed.gov/?id=EJ7 78645. 


Zhou, N. (2014). Effects of RCT Storybook Storybook 36 students L RD Target vocabulary test 0.98 ee 
multimedia story reading on reading with reading in several 

preschoolers’ vocabulary learning, questions preschools 

story comprehension and reading Multimedia Multimedia 37 students L RD Target vocabulary test 0.17 
engagement (UMI Ne: 3669649) story reading story in several 

[Doctoral dissertation, Purdue d with questions reading preschools 

University]. ProQuest Dissertations 

and Theses database. 

Zucker, T. A., Solari, E. J., Landry, S. Cluster Atrisk Tier 2: At-risk 119 students L RD Listening 0.06 
H., & Swank, P. R. (2013). Effects of RCT Developing comparison — in 39 classrooms comprehension 

a brief tiered language intervention Talkers in Head Start S CIRCLE Phonological Hee 
for prekindergartners at risk. Early centers, private 


Awareness, Language, 


sit & Development, 24(3), childcare ‘ and Literacy System: 
366-39 - pideraingyenh Rapid vocabulary 
https://eric.ed.gov/?id=EJ1010582. public schools 


naming 


* is significant at p < .05; ** is significant at p < .01; *** is significant at p < .001. 

Study design: RCT is randomized controlled trial. 

Outcome domain: D is decoding. G is general literacy. L is language. PA is phonological awareness. PK is print knowledge. W is early writing. 

Type of outcome measure: RD is researcher-developed measure. S is standardized measure. 

Effect size for measure: ne is not enough information provided in the manuscript to calculate effect size (ne* indicates that the direction of the effect was positive, and ne" indicates that the direction of the effect 
is unknown). 

Outcome measure: APT is Action Picture Test. BPVS is British Picture Vocabulary Scale. CELF is Clinical Evaluation of Language Fundamentals. CIRCLE is Center for Improving the Readiness of Children for Learning 
and Education. CLIP is Code and Language Intervention Post-test. COS is Clay’s Observation Survey of Early Literacy Achievement. CPAA is Children’s Progress Academic Assessment. CTOPP is Comprehensive Test 
of Phonological Processing. DELV is Diagnostic Evaluation of Language Variation. DIBELS is Dynamic Indicators of Basic Literacy Skills. EOWPVT is Expressive One-Word Picture Vocabulary Test. GGG is Get it, Got it, 
Go!. GRTR is Get Ready to Read. IGDI is Get It, Got It, Go! Individual Growth and Development Indicators. PALS is Phonological Awareness Literacy Screening. PAT is Phonological Awareness Test. PIPA is Pre- 
Reading Inventory of Phonological Awareness. PPVT is Peabody Picture Vocabulary Test. PWPA is Preschool Print and Word Awareness Assessment. TERA is Test of Early Reading Ability. TOLD is Test of Language 
Development. TOPA is Test of phonological awareness. TOPEL is Test of Preschool Emergent Literacy. TTR is Type Token Ratio. WJ is Woodcock-Johnson. WRAT is Wide Range Achievement Test. YARC is York 
Assessment of Reading Comprehension. 

B-H correction is Benjamini-Hochberg correction (see box B1). 

Note: Two studies (Wasik & Bond, 2001, and Zucker et al., 2013) reported sufficient information to calculate effect size for some outcomes but not all. 

Source: Authors’ compilation. 
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Table E2. Research basis for the 14 single-case design studies determined to meet the evidence standards 


SCD 
Intervention Sample size Outcome Vite (=1aler 
Citation Designtype name (case) type Outcome measure level? 
Bredin-Oja, S. L. (2012). Children’s responses to Alternating Grammatically 1 (student 2) RD Number of responses No 
grammatically complete and incomplete prompts to treatment complete and containing atarget semantic evidence 
imitate (UMI No. 3541650) [Doctoral dissertation, incomplete relation 
University of Kansas]. ProQuest Dissertations & Theses prompts to 
database. imitate 
Craig-Unkefer, L. A. (1999). Increasing the social- Multiple Play sessions 6 (dyad 1, RD Peer-directed descriptive No 
communicative skills of at-risk preschool-age childrenin baseline dyad 2, dyad 3) statements evidence 
a play context (UMI No. 9929116) [Doctoral across Peer-directed requests No 
dissertation, Vanderbilt University]. ProQuest participants avidence 
Dissertations & Theses database. 
Peer-directed comments No 
plus requests evidence 
Number of four or more No 
word utterances evidence 
Number of different word No 
roots evidence 
Total words No 
evidence 
Craig-Unkefer, L. A., & Kaiser, A. P. (2002). Improving Multiple Peer play 6 (dyad 1, RD Descriptive utterances No 
the social communication skills of at-risk preschool baseline dyad 2, dyad 3) evidence 
children ina play context. Topics in Early Childhood across Request utterances No 
Special Education, 22(1), 3-13. participants aiidenee 
https://eric.ed.gov/?id=EJ645081. 
Dennis, L. R., Whalon, K., Kraut, L., & Herron, D.(2016). Alternating iPad 1 (participant RD Expressive probe gain score No 
Effects of a teacher versus iPad-facilitated intervention treatment instruction of 1) evidence 
on the vocabulary of at-risk preschool children. Journal target verb RD Receptive probe gain score No 
of Early intervention, 38(3), 170-186. evidence 
https://eric.ed.gov/?id=EJ1113679. 
1 (participant RD Expressive probe gain score No 
2) evidence 
RD Receptive probe gain score Moderate 
(-) 
1 (participant RD Expressive probe gain score No 
3) evidence 
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ScD 
Intervention Sample size Outcome Outcome evidence 
Citation Designtype name (case) domain type Outcome measure level? 
RD Receptive probe gain score No 
evidence 
1 (participant L RD Expressive probe gain score No 
4) evidence 
RD Receptive probe gain score No 
evidence 
1 (participant L RD Expressive probe gain score No 
5) evidence 
RD Receptive probe gain score No 
evidence 
Hsin, Y. W. (2007). Effects of phonological awareness Multiple Phonological 1 (Tracy, Steph, PA S DIBELS: Phoneme No 
instruction on pre-reading skills of preschool children probe awareness Henry) segmentation fluency evidence 
at-risk for reading disabilities [Doctoral dissertation, across instruction DIBERS: Nanseneeword No 
The Ohio State University]. Retrieved November 29, participants fluency euidence 
2018, from https://etd.ohiolink.edu/. 
Kruse, L. (2013). Small groups, big gains: Efficacy of a Multiple Phonological 7 (Eva, PA RD Modified DIBELS first sound No 
tier 2 phonological awareness intervention with probe awareness Courtney, fluency evidence 
preschoolers using a multiple-baseline design (UMI No. across intervention Teshwan, Modified DIBELS word parts Ala 
3673735) [Doctoral dissertation, The Ohio State participants Andre, Kaylee, fluency avidanee 
University]. ProQuest Dissertations and Theses Anna, Cristina) 
database. 
Lovelace, T. S. (2008). The effects of explicit Multiple Multiple skill 1 (student 1) PA RD Number correct on multiple Strong 
phonological awareness instruction on the prereading baseline phonological phonological awareness (+) 
skills of preschool children at risk for reading failure: across awareness tasks 
Comparing single area ee settings instruction 1 (student 5) PA RD Number correct on multiple No 
strategies [Doctora dissertation, The Ohio State phonological awareness evidence 
University]. Retrieved August 3, 2018, from fgks 
https://etd.ohiolink.edu/. 
McLeod, R. H., Hardy, J. K., & Kaiser, A. P. (2017). The Multiple Book reading 1 (Caleb) L RD Number of target words Strong 
effects of play-based intervention on vocabulary probe and Enhanced used (+) 
acquisition by preschoolers at risk for reading and across Milieu 1 (Jacorius) L RD Number of target words No 
language delays. Journal of Early Intervention, 39(2), settings Teaching play weed avidence 


147-160. https://eric.ed.gov/?id=EJ1140020. 
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ScD 
Intervention Sample size Outcome Outcome Vite (=1aler 
Citation Designtype name (case) domain type Outcome measure level? 
Noe, S., Spencer, T. D., Kruse, L., & Goldstein, H. (2014). Multiple Phonological 7 (Jerome, PA S DIBELS: First sound fluency No 
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strategy in a storybook context on the acquisition, baseline teaching behaviors evidence 
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disabilities (Order No. 9801786) [Doctoral dissertation, 
The Ohio State University]. ProQuest Dissertations and 
Theses database. 
Stanton-Chapman, T. L. (2004). Building social Alternating Book reading 1 (A1) L RD Social programmatic No 
communication skills during peer interaction using treatment and play outcome evidence 
storybooks (UMI No. 3127279) [Doctoral dissertation, 1 (A2) L RD Social programmatic No 
Vanderbilt University]. ProQuest Dissertations and auicane evidence 
Theses database. 
1 (B1) L RD Social programmatic No 
outcome evidence 
1 (B2) L RD Social programmatic No 
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1 (C1) L RD Social programmatic No 
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1 (C2) L RD Social programmatic No 
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1 (D1) L RD Social programmatic No 
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outcome evidence 


eB) 


Intervention Sample size Outcome Outcome Vite (=1aler 
Citation Designtype name (K-)) domain type Outcome measure level? 
Stanton-Chapman, T. L., Denning, C. B., & Jamison, K.R. Multiple Book reading 8 (A1, A2, B1, L RD Frequency of initiated Moderate 
(2012). Communication skill building in young children baseline and play B2, C1, C2, D1, behavior that resulted ina (+) 
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The Journal of Special Education, 46(2), 78-93. participants 
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preschoolers (UMI No. 3095690) [Doctoral dissertation, across Leslie) Mean length of utterance No 
The University of Memphis]. ProQuest Dissertations participants evidence 


and Theses database. 


Outcome domain: D is decoding. G is general literacy. L is language. PA is phonological awareness. PK is print knowledge. W is early writing. 
Type of outcome measure: S is standardized measure. RD is researcher-developed measure. 

Outcome measure: DIBELS is Dynamic Indicators of Basic Literacy Skills. 

Note: See appendix F for the complete citation associated with each study evaluating the interventions. 

a. Refers to the characterization of findings under the pilot What Works Clearinghouse standards for single-case designs. 

Source: Authors’ compilation. 
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